Mojo function
fa4_correction
fa4_correction[qkv_dtype: DType, rope_dtype: DType, scale_dtype: DType, MaskType: MHAMask, //, config: FA4Config[qkv_dtype, rope_dtype=rope_dtype, scale_dtype=scale_dtype], page_size: Int](smem: SM100AttentionSMem[config], score_row: UInt32, num_keys: UInt32, mask: MaskType)
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!