For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo module

grouped_matmul_block_scaled_dispatch

General dispatch for grouped block-scaled matmul.

Routes to format-specific grouped matmul implementations based on the input dtype and target GPU architecture. Currently supports NVFP4, MXFP4, and MXFP8 on SM100.

Functions

grouped_matmul_block_scaled_dispatch: Dispatch grouped block-scaled matmul to format-specific implementation.

Functions​

Functions