SKaiNET
Toggle table of contents
0.20.0-SNAPSHOT
common
Target filter
common
Switch theme
Search in API
Skip to content
SKaiNET
skainet-lang-core
/
sk.ainet.lang.tensor.storage
/
KvCacheConfig
/
Companion
Companion
object
Companion
(
source
)
Members
Functions
dense
Link copied to clipboard
fun
dense
(
numLayers
:
Int
,
numHeads
:
Int
,
headDim
:
Int
,
maxSeqLen
:
Int
)
:
KvCacheConfig
Uncompressed FP32 cache (baseline).
q8
Link copied to clipboard
fun
q8
(
numLayers
:
Int
,
numHeads
:
Int
,
headDim
:
Int
,
maxSeqLen
:
Int
)
:
KvCacheConfig
Q8_0-compressed cache for both K and V.