Mojo struct
MLASmemStorage
struct MLASmemStorage[dtype: DType, num_mbars: Int, config: FA4Config]
Fields
- q_smem (
InlineArray[Scalar[dtype], MLASmemStorage[dtype, num_mbars, config].q_smem_size]): - kv_smem (
InlineArray[Scalar[dtype], MLASmemStorage[dtype, num_mbars, config].kv_smem_size]): - correction_smem (
InlineArray[Float32, MLASmemStorage[dtype, num_mbars, config].correction_smem_size]): - mbar_base (
InlineArray[SharedMemBarrier, num_mbars]): - tmem_addr (
InlineArray[UInt32, 1]):
Implemented traits
AnyType,
ImplicitlyDestructible
comptime members
__del__is_trivial
comptime __del__is_trivial = True
correction_smem_size
comptime correction_smem_size = config.correction_smem_elements()
kv_smem_size
comptime kv_smem_size = ((config * config) * MLASmemStorage[dtype, num_mbars, config].num_kv_stages)
num_kv_stages
comptime num_kv_stages = (config * config)
q_smem_size
comptime q_smem_size = (config * config)
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!