TurboQuantPreset

data class TurboQuantPreset(val name: String, val cacheConfig: KvCacheConfig, val keyQuantConfig: TurboQuantConfig?, val valueQuantConfig: TurboQuantConfig?)(source)

A named TurboQuant preset with all configuration needed to create a cache.

Constructors

Link copied to clipboard
constructor(name: String, cacheConfig: KvCacheConfig, keyQuantConfig: TurboQuantConfig?, valueQuantConfig: TurboQuantConfig?)

Properties

Link copied to clipboard
Link copied to clipboard

TurboQuant config for keys, or null if keys use non-TurboQuant encoding.

Link copied to clipboard
Link copied to clipboard

TurboQuant config for values, or null if values use non-TurboQuant encoding.