RMSNormalization

constructor(normalizedShape: IntArray, eps: Double = 1.0E-5, name: String = "RMSNormalization", initWeight: Tensor<T, V>? = null)(source)

Parameters

normalizedShape

The shape of the normalization (typically the last dimension)

eps

Small value added to the denominator for numerical stability

name

Name of the module

initWeight

Initial weight (scale) parameter