skainet-lang-core/sk.ainet.lang.tensor.data/Q4_KBlockTensorData

Q4_KBlockTensorData

class Q4_KBlockTensorData(initialShape: Shape, data: ByteArray) : Q4_KTensorData, PackedBlockStorage(source)

Implementation of Q4_KTensorData backed by a packed byte array.

Memory layout per block (144 bytes):

bytes 0..1: f16 d (little-endian)
bytes 2..3: f16 dMin (little-endian)
bytes 4..15: packed 12-bit scale/min indices (12 bytes)
bytes 16..143: 4-bit quantized codes (128 bytes, 2 codes per byte)

Scale packing: Each sub-block uses 12 bits (6 for scaleIdx, 6 for minIdx). 8 sub-blocks × 12 bits = 96 bits = 12 bytes.

Parameters

initialShape

the logical shape of the tensor (in elements, not blocks)

packedData

the raw packed block data

Constructors

Q4_KBlockTensorData

constructor(initialShape: Shape, data: ByteArray)

Types

Companion

object Companion

Properties

blockCount

open override val blockCount: Int

Number of Q4_K blocks in the tensor.

blockSize

open override val blockSize: Int

Number of logical elements per block.

encoding

open override val encoding: TensorEncoding

The physical encoding describing the block layout.

packedData

open override val packedData: ByteArray

Raw packed data containing all blocks.

shape

open override val shape: Shape

The shape descriptor that defines the dimensionality and size of this tensor data.

Functions

dequantizeBlock

open override fun dequantizeBlock(blockIdx: Int, output: FloatArray, outputOffset: Int = 0)

Dequantize a single block to float values.

get

open operator override fun get(vararg indices: Int): Byte

Retrieves an element at the specified multidimensional indices.

getBlockD

open override fun getBlockD(blockIdx: Int): Float

Get the main scale factor (d) for a block.

getBlockDMin

open override fun getBlockDMin(blockIdx: Int): Float

Get the minimum scale factor (dMin) for a block.

getCode

open override fun getCode(blockIdx: Int, elementIdx: Int): Int

Get a 4-bit quantized code value (0..255 elements within block).

getSubBlockMin

open override fun getSubBlockMin(blockIdx: Int, subBlockIdx: Int): Float

Get the minimum value for a specific sub-block within a block.

getSubBlockScale

open override fun getSubBlockScale(blockIdx: Int, subBlockIdx: Int): Float

Get the scale for a specific sub-block within a block.

set

open operator override fun set(vararg indices: Int, value: Byte)

Setter