skainet-lang-core/sk.ainet.lang.tensor.ops.turboquant/TurboQuantPreset

TurboQuantPreset

data class TurboQuantPreset(val name: String, val cacheConfig: KvCacheConfig, val keyQuantConfig: TurboQuantConfig?, val valueQuantConfig: TurboQuantConfig?)(source)

A named TurboQuant preset with all configuration needed to create a cache.

Constructors

TurboQuantPreset

constructor(name: String, cacheConfig: KvCacheConfig, keyQuantConfig: TurboQuantConfig?, valueQuantConfig: TurboQuantConfig?)

Properties

val cacheConfig: KvCacheConfig

val keyQuantConfig: TurboQuantConfig?

TurboQuant config for keys, or null if keys use non-TurboQuant encoding.

val name: String

valueQuantConfig

val valueQuantConfig: TurboQuantConfig?

TurboQuant config for values, or null if values use non-TurboQuant encoding.