skainet-lang-core/sk.ainet.lang.tensor/TurboQuantEncodeBenchmark

TurboQuantEncodeBenchmark

open class TurboQuantEncodeBenchmark(source)

JMH benchmarks for TurboQuant KV-cache compression.

Measures encode/decode throughput, compression ratio, and accuracy for different TurboQuant configurations.

Run: ./gradlew :skainet-lang:skainet-lang-core:jvmBenchmark

Constructors

TurboQuantEncodeBenchmark

constructor()

Functions

encode_3bit_128d

fun encode_3bit_128d(): TurboQuantBlock

encode_4bit_128d

fun encode_4bit_128d(): TurboQuantBlock

encode_4bit_256d

fun encode_4bit_256d(): TurboQuantBlock

encode_4bit_qjl_128d

fun encode_4bit_qjl_128d(): TurboQuantBlock

encode_8bit_128d

fun encode_8bit_128d(): TurboQuantBlock

fun setup()