For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).
Mojo module
dispatch
Provides the SM100 (Blackwell) flash-attention host-side dispatch entry point that selects a 1Q or 2Q FA4 kernel configuration, builds the Q/K/V/O TMA descriptors and tile scheduler, and enqueues the kernel onto the device.
comptime values
logger
comptime logger = Logger(stdout, prefix=String(""), source_location=False)
Functions
-
mha_sm100_dispatch: Dispatches the SM100 FA4 flash-attention kernel for a prefill workload.
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!