Mojo module

mla_decode_dispatch

comptime values

logger

comptime logger = Logger(stdout, prefix=String(""), source_location=False)

Structs

• ​MLADispatchScalarArgs: Pre-computed MLA decode args for the legacy (non-capturable) path.

Functions

• ​compute_mla_dispatch_scalars: Pure computation of the packed 3-value MLA dispatch metadata.
• ​compute_mla_dispatch_scalars_runtime:
• ​launch_mla_sm100_decode_enqueue_kernel:
• ​launch_mla_sm100_decode_fp8_per_token_scale_rope_aware: Launch the FP8 per-token-scale rope-aware MLA decode kernel with split content/rope TMAs.
• ​launch_mla_sm100_decode_native_fp8: Launch the native FP8 MLA decode kernel with FP8 Q TMA.
• ​launch_mla_sm100_decode_sparse: Launch the sparse MLA decode kernel with gather4 TMA descriptors.
• ​launch_mla_sm100_decode_sparse_kv_fp8: Launches the all-FP8 sparse MLA decode kernel.
• ​mla_decode_sm100_dispatch:
• ​mla_decode_sm100_sink_split_k:

Was this page helpful?

Thank you! We'll create more content like this.

Thank you for helping us improve!

😔 What went wrong?

Some code doesn’t work

It includes inaccurate information

It's missing information I need

It was difficult to understand

Other

Submit