For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).

Mojo module

index_fp8

Implements tensor indexing and gather kernels with FP8 quantization support on Blackwell GPUs.

Structs

• ​IndexSmemStorage: Holds shared-memory buffers for the query, key, and scratch tiles used by the FP8 index kernel.

Functions

• ​fp8_index: Dispatches the FP8 index/gather scorer on the given device context.
• ​fp8_index_kernel: Computes the scalar FP8 index/gather score kernel as a Blackwell tensor-core fallback.
• ​fp8_index_naive: Computes the FP8 index/gather score via a two-pass matmul-then-reduce reference path.

Was this page helpful?

Thank you! We'll create more content like this.

Thank you for helping us improve!

😔 What went wrong?

Some code doesn’t work

It includes inaccurate information

It's missing information I need

It was difficult to understand

Other

Submit