InternalMixedPrecisionModule
abstract class InternalMixedPrecisionModule<TIO : DType, TInternal : DType, V>(ioType: TIO, internalType: TInternal, conversionOps: MixedPrecisionTensorOps<V>) : Module<TIO, V> (source)
Specialized mixed precision module for cases where input and output types are the same but internal computation uses a different precision.
This is commonly used for layers where weights are stored in low precision (e.g., INT8) but computations are performed in higher precision (e.g., FP16) for accuracy.
Parameters
TIO
The input/output precision type
TInternal
The internal computation precision type
V
The value type corresponding to the DType