readValueStorage

open override fun readValueStorage(layer: Int, startPos: Int = 0, endPos: Int = currentSeqLen): TensorStorage(source)

Read raw (possibly compressed) value storage for a layer as TensorStorage.

Parameters

layer

Layer index

startPos

First token position (inclusive)

endPos

Last token position (exclusive)