Mojo function
layer_norm
layer_norm[dtype: DType](input: Symbol, gamma: Symbol, beta: Symbol, epsilon: SIMD[dtype, 1]) -> Symbol
Performs layer normalization.
Args:
- βinput (
Symbol
): The input tensor to normalize. - βgamma (
Symbol
): The gamma parameter of the normalization. - βbeta (
Symbol
): The beta parameter of the normalization. - βepsilon (
SIMD[dtype, 1]
): The epsilon parameter of the normalization.
Returns:
A symbolic tensor value with the normalization applied.
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!
π What went wrong?