skainet-lang-core/sk.ainet.lang.tensor.ops.turboquant/QuantizedVector

QuantizedVector

data class QuantizedVector(val codes: ByteArray, val scales: FloatArray, val bits: Int)(source)

Result of scalar quantization: integer codes + per-group scales.

Constructors

QuantizedVector

constructor(codes: ByteArray, scales: FloatArray, bits: Int)

Properties

Number of bits per code.

val codes: ByteArray

Signed integer codes, one per element. Values in -maxCode, maxCode.

val elementCount: Int

val numGroups: Int

val scales: FloatArray

Per-group scale factors (one per GROUP_SIZE elements).

Functions

open operator override fun equals(other: Any?): Boolean

open override fun hashCode(): Int