IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.

Skip to main content

For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo module

rms_norm_fused_residual

RMSNorm with fused residual connection for state space models.

Functions

rms_norm_fused_residual: Applies fused residual add and RMS layer normalization.
rms_norm_fused_residual_cpu: Generic rank wrapper that delegates to the 2D core implementation.
rms_norm_fused_residual_gpu: Dispatches the fused RMS-norm-plus-residual kernel on GPU.
rms_norm_fused_residual_gpu_block:

Functions