Q4MemorySegmentMarker

Marker interface for Q4 quantized data backed by a MemorySegment. Enables DefaultCpuOpsJvm to dispatch to MemorySegment-based Q4 kernels.

Inheritors

Properties

Link copied to clipboard
abstract val blockCount: Int

Number of Q4_0 blocks in the tensor.

Link copied to clipboard
abstract val blockSize: Int

Elements per block.

Link copied to clipboard
abstract val bytesPerBlock: Int

Bytes per block.