LlamaRuntimeWeights

data class LlamaRuntimeWeights<T : DType>(val metadata: LlamaModelMetadata, val tokenEmbedding: Tensor<T, Float>, val ropeFreqReal: Tensor<T, Float>?, val ropeFreqImag: Tensor<T, Float>?, val layers: List<LlamaLayerWeights<T>>, val outputNorm: Tensor<T, Float>, val outputWeight: Tensor<T, Float>, val quantTypes: Map<String, GGMLQuantizationType> = emptyMap())(source)

Constructors

Link copied to clipboard
constructor(metadata: LlamaModelMetadata, tokenEmbedding: Tensor<T, Float>, ropeFreqReal: Tensor<T, Float>?, ropeFreqImag: Tensor<T, Float>?, layers: List<LlamaLayerWeights<T>>, outputNorm: Tensor<T, Float>, outputWeight: Tensor<T, Float>, quantTypes: Map<String, GGMLQuantizationType> = emptyMap())

Properties

Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard