skainet-lang-core/sk.ainet.lang.nn.optim/Optimizer

Optimizer

interface Optimizer(source)

Minimal optimizer surface for training.

Inheritors

Functions

abstract fun addParameter(param: ModuleParameter<*, *>, applyWeightDecay: Boolean = true)

Register a raw module parameter to be optimized.

abstract fun addParameter(param: Parameter, applyWeightDecay: Boolean = true)

Register a parameter to be optimized.

abstract fun step()

Perform one optimization step, updating all registered parameters in-place (via reassigning their tensor values where needed).

abstract fun zeroGrad()

Zero accumulated gradients on all registered parameters.