Q4MemorySegmentTensorData

class Q4MemorySegmentTensorData(initialShape: Shape, val segment: MemorySegment, val segmentByteOffset: Long = 0) : TensorData<DType, Byte> , Q4MemorySegmentMarker(source)

Q4_0 quantized tensor data backed by a MemorySegment.

Q4_0 block layout (18 bytes per 32 elements):

Dequantization: outputi = (nibblei - 8) * scale

The segment is arena-managed and 64-byte aligned for SIMD access.

Constructors

constructor(initialShape: Shape, segment: MemorySegment, segmentByteOffset: Long = 0)

open override val blockCount: Int

Number of Q4_0 blocks in the tensor.

open override val blockSize: Int = 32

Elements per block.

open override val bytesPerBlock: Int = 18

Bytes per block.

open override val segment: MemorySegment

The underlying off-heap memory segment.

Byte offset into segment where this tensor's data starts.

open override val shape: Shape

The shape descriptor that defines the dimensionality and size of this tensor data.

Copies all tensor data to a FloatArray.

open operator override fun get(vararg indices: Int): Byte

Retrieves an element at the specified multidimensional indices.

open operator override fun set(vararg indices: Int, value: Byte)

Setter