Mojo function
fa4_mma
fa4_mma[MaskType: MHAMask, //, config: FA4Config[config.qkv_dtype, rope_dtype=config.rope_dtype, scale_dtype=config.scale_dtype], *, page_size: Int](smem: SM100AttentionSMem[config], score_row: UInt32, num_keys: UInt32, mask: MaskType)
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!