LlamaLayerWeights

data class LlamaLayerWeights<T : DType>(val attnNorm: Tensor<T, Float>, val wq: Tensor<T, Float>, val wk: Tensor<T, Float>, val wv: Tensor<T, Float>, val wo: Tensor<T, Float>, val ffnNorm: Tensor<T, Float>, val ffnGate: Tensor<T, Float>, val ffnDown: Tensor<T, Float>, val ffnUp: Tensor<T, Float>)(source)

Constructors

Link copied to clipboard
constructor(attnNorm: Tensor<T, Float>, wq: Tensor<T, Float>, wk: Tensor<T, Float>, wv: Tensor<T, Float>, wo: Tensor<T, Float>, ffnNorm: Tensor<T, Float>, ffnGate: Tensor<T, Float>, ffnDown: Tensor<T, Float>, ffnUp: Tensor<T, Float>)

Properties

Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
val wk: Tensor<T, Float>
Link copied to clipboard
val wo: Tensor<T, Float>
Link copied to clipboard
val wq: Tensor<T, Float>
Link copied to clipboard
val wv: Tensor<T, Float>