Q8MemorySegmentTensorData

class Q8MemorySegmentTensorData(initialShape: Shape, val segment: MemorySegment, val segmentByteOffset: Long = 0) : TensorData<DType, Byte> , Q8MemorySegmentMarker(source)

Q8_0 quantized tensor data backed by a MemorySegment.

Q8_0 block layout (34 bytes per 32 elements):

Dequantization: outputi = codei * scale

The segment is arena-managed and 64-byte aligned for SIMD access.

Constructors

constructor(initialShape: Shape, segment: MemorySegment, segmentByteOffset: Long = 0)

open override val blockCount: Int

Number of Q8_0 blocks in the tensor.

open override val blockSize: Int = 32

Elements per block (always 32).

open override val bytesPerBlock: Int = 34

Bytes per block (always 34).

open override val segment: MemorySegment

The underlying off-heap memory segment.

Byte offset into segment where this tensor's data starts.

open override val shape: Shape

The shape descriptor that defines the dimensionality and size of this tensor data.

Copies all tensor data to a FloatArray.

open operator override fun get(vararg indices: Int): Byte

Retrieves an element at the specified multidimensional indices.

open operator override fun set(vararg indices: Int, value: Byte)

Setter