Mojo module
attention
FA4 (Flash Attention 4) configuration for SM100 (Blackwell) kernels.
comptime values
EnableEarlyAdd
comptime EnableEarlyAdd = get_defined_bool[StringSlice("FA4AddEarly")]()
EnableForcedOrdering
comptime EnableForcedOrdering = get_defined_bool[StringSlice("FA4ForcedSoftmaxOrdering")]()
Structs
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!