For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).
Mojo module
rms_norm_fused_residual
RMSNorm with fused residual connection for state space models.
Functions
-
rms_norm_fused_residual: Applies fused residual add and RMS layer normalization. -
rms_norm_fused_residual_cpu: Generic rank wrapper that delegates to the 2D core implementation. -
rms_norm_fused_residual_gpu: Dispatches the fused RMS-norm-plus-residual kernel on GPU. -
rms_norm_fused_residual_gpu_block: GPU block kernel: fused residual add, optional dropout, and RMS normalization.
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!