LayerScale

constructor(dim: Int, name: String = "LayerScale", initScale: Tensor<T, V>? = null)(source)

Parameters

dim

Number of channels

name

Module name

initScale

Initial scale tensor (shape: dim), typically initialized to a small value (e.g. 0.01)