LayerNormalization
constructor(normalizedShape: IntArray, eps: Double = 1.0E-5, elementwiseAffine: Boolean = true, name: String = "LayerNormalization", initGamma: Tensor<T, V>? = null, initBeta: Tensor<T, V>? = null)(source)
Parameters
normalizedShape
The shape of the normalization (typically the last dimension(s))
eps
Small value added to the denominator for numerical stability
elementwiseAffine
Whether to learn elementwise affine parameters (gamma and beta)
name
Name of the module
initGamma
Initial gamma (scale) parameter
initBeta
Initial beta (shift) parameter