For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo module

launch_attribute

GPU Launch Attributes for Kernel Execution Control.

This module provides structures for configuring GPU kernel execution through launch attributes. It implements a Mojo interface to CUDA's launch attribute system, allowing fine-grained control over kernel execution characteristics such as memory access policies, synchronization behavior, cluster dimensions, and resource allocation.

The main components include:

• LaunchAttributeID: Identifies different types of launch attributes
• LaunchAttributeValue: Stores the value for a specific attribute type
• LaunchAttribute: Combines an ID and value to form a complete attribute
• AccessPolicyWindow: Configures memory access patterns and caching behavior
• AccessProperty: Defines cache persistence properties for memory access

These structures enable optimizing GPU kernel performance by controlling execution parameters at a granular level, similar to CUDA's native launch attribute system.

Structs

• ​AccessPolicyWindow: Specifies an access policy for a window of memory.
• ​AccessProperty: Specifies performance hint with AccessPolicyWindow for hit_prop and miss_prop fields.
• ​LaunchAttribute: Represents a complete launch attribute with ID and value.
• ​LaunchAttributeID: Identifies the type of launch attribute for GPU kernel execution.
• ​LaunchAttributeValue: Represents a value for a CUDA launch attribute.