Mojo module
mha_utils
comptime valuesβ
callback_fn_typeβ
comptime callback_fn_type = def[mask_t: MHAMask](mask: mask_t) raises capturing -> None
is_sm100β
comptime is_sm100 = String(_accelerator_arch()).__contains__(StringSlice("sm_100")) or String(_accelerator_arch()).__contains__(StringSlice("sm_103"))
is_sm90β
comptime is_sm90 = String(_accelerator_arch()).__contains__(StringSlice("sm_90"))
is_sm90or100β
comptime is_sm90or100 = is_sm90 or is_sm100
Structsβ
- β
DynamicInt: - β
FlashAttentionAlgorithm: - β
MHAConfig: - β
NoPartition: - β
SplitKPartition: - β
StaticInt:
Traitsβ
Functionsβ
- β
as_dynamic_row_major_1d: - β
dispatch_mask: - β
dispatch_materialized_mask: - β
get_start_and_end_for_partitions: Calculate start and end indices for a partition.
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!