For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo module

tcgen05

This module includes utilities for working with the tensorcore 5th generation (tcgen05) instructions.

Structs

• ​TensorMemory: A wrapper around tensor memory allocated for tcgen05 instructions.

Functions

• ​check_blackwell_constraint: Compile-time constraint ensuring Blackwell hardware is targeted.
• ​tcgen05_alloc: Allocates tensor memory for use with tcgen05 instructions.
• ​tcgen05_cp: Copies data from shared memory described by the matrix descriptor s_desc to tensor memory tmem_addr.
• ​tcgen05_dealloc: Deallocates tensor memory allocated by tcgen05_alloc().
• ​tcgen05_fence_after: Orders all the subsequent asynchronous tcgen05 operations.
• ​tcgen05_fence_before: Orders all the prior asynchronous tcgen05 operations.
• ​tcgen05_ld: Loads data from tensor memory into registers.
• ​tcgen05_load_wait: Waits for tensor memory loads to complete.
• ​tcgen05_release_allocation_lock: Releases the allocation lock for the current CTA group.
• ​tcgen05_st: Stores data from registers into tensor memory.
• ​tcgen05_store_wait: Waits for tensor memory stores to complete.

Was this page helpful?

Thank you! We'll create more content like this.

Thank you for helping us improve!

😔 What went wrong?

Some code doesn’t work

It includes inaccurate information

It's missing information I need

It was difficult to understand

Other

Submit