skainet-lang-core/sk.ainet.lang.tensor.storage/KvCacheStore/Companion

Companion

object Companion(source)

Functions

fun dense(numLayers: Int, numHeads: Int, headDim: Int, maxSeqLen: Int): KvCacheStore

Create an uncompressed FP32 KV cache (baseline).

fun fromPreset(preset: TurboQuantPreset): KvCacheStore

Create a KV cache from a TurboQuantPreset.

fun turboQuant(preset: String, numLayers: Int, numHeads: Int, headDim: Int, maxSeqLen: Int): KvCacheStore

Create a TurboQuant-compressed KV cache from a named preset.

fun turboQuant(numLayers: Int, numHeads: Int, headDim: Int, maxSeqLen: Int, keyBits: Int = 4, valueBits: Int = 4, useQjl: Boolean = false): KvCacheStore

Create a TurboQuant-compressed KV cache with custom bit budgets.