Q8MemorySegmentMarker

Marker interface for Q8_0 quantized data backed by a MemorySegment. Enables DefaultCpuOpsJvm to dispatch to MemorySegment-based Q8 kernels.

Inheritors

Properties

Link copied to clipboard
abstract val blockCount: Int

Number of Q8_0 blocks in the tensor.

Link copied to clipboard
abstract val blockSize: Int

Elements per block (always 32).

Link copied to clipboard
abstract val bytesPerBlock: Int

Bytes per block (always 34).