Mojo struct
IndexSmemStorage
struct IndexSmemStorage[dtype: DType, num_heads: Int, depth: Int, BN: Int]
Fields
- q_smem (
InlineArray[Scalar[dtype], (num_heads * depth)]): - k_smem (
InlineArray[Scalar[dtype], (BN * depth)]): - scratch (
InlineArray[Float32, (BN * 8)]):
Implemented traits
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!