Skip to main content

Mojo package

amd_structured

Structured AMD GPU attention kernels (TileTensor hot path).

Modules​

  • ​hw_ops: TileTensor-native AMD GPU hardware operations for MHA.
  • ​kv_buffer: KV cache buffer for structured MHA kernels (TileTensor hot path).
  • ​tile_utils: TileTensor utilities for block-aligned SMEM tiling.

Was this page helpful?