ScaledDotProductAttentionOperation

Scaled dot-product attention operation for tape recording. Output shape = query shape: batch, nHeads, seqLen, headDim

Constructors

constructor(parameters: Map<String, Any> = emptyMap())

open override fun clone(newParameters: Map<String, Any> = parameters): Operation

Clone this operation with potentially different parameters

open override fun <T : DType, V> execute(inputs: List<Tensor<T, V>>): List<Tensor<T, V>>

Execute this operation with the given inputs

Infer the output tensor specifications from input specifications

Validate that the given inputs are compatible with this operation