storeKeyValue
Store K/V projections for a new token, compressing as configured.
Parameters
layer
Layer index
key
Key projection numHeads, headDim
value
Value projection numHeads, headDim
Store K/V projections for a new token, compressing as configured.
Layer index
Key projection numHeads, headDim
Value projection numHeads, headDim