For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo module
warp_specialized_blockwise_fp8
Implements a warp-specialized blockwise FP8 matrix multiplication kernel for NVIDIA SM100 (Blackwell) GPUs.
Functionsβ
- β
blackwell_tma_umma_warp_specialized_blockwise_fp8_kernel: Implements the warp-specialized blockwise FP8 GEMM kernel for SM100 using TMA loads, UMMA tensor-core MMA, and a CLC tile scheduler. - β
load_AB: Loads A, B, and A-scales tiles into shared memory via multicast TMA for one pipeline stage. - β
multi_stage_reg_epilogue: Casts register accumulators to the output type and stores each stage to global memory via TMA. - β
promote_accumulators: Promotes FP8 MMA partial products by applying blockwise A and B scales to the tensor-memory accumulators. - β
sm100_warp_specialized_blockwise_fp8: Sets up TMA descriptors, shared-memory layouts, and pipeline barriers, then launches the blockwise FP8 GEMM kernel on SM100.