IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.

Skip to main content

For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo module

mha_cross

Implements a naive GPU multihead cross attention kernel supporting ragged batched inputs and a paged KV cache.

Functions

mha_cross_gpu_naive: Naive cross attention on GPU.

Functions