Mojo struct
MatmulConfig
struct MatmulConfig[a_type: DType, b_type: DType, c_type: DType, transpose_b: Bool = True]
Static configuration of GPU matmul.
Fieldsβ
- βcta_group (
Int): - βmma_shape (
IndexList[3]): - βcluster_shape (
IndexList[3]): - βAB_swapped (
Bool): - βblock_swizzle_size (
Int): - βraster_order (
RasterOrder): - βregister_based_epilogue (
Bool): - βblock_tile_shape (
IndexList[3]): - βnum_split_k (
Int): - βnum_pipeline_stages (
Int): - βnum_clc_pipeline_stages (
Int): - βnum_accum_pipeline_stages (
Int): - βnum_output_stages (
Int): - βoutput_tile_shape (
IndexList[2]): - βa_swizzle (
TensorMapSwizzle): - βb_swizzle (
TensorMapSwizzle): - βc_swizzle (
TensorMapSwizzle): - βk_group_size (
Int): - βprefetch_tiles_n (
Int): - βgemm_kind (
GEMMKind):
Implemented traitsβ
AnyType,
Copyable,
Equatable,
Hashable,
ImplicitlyCopyable,
ImplicitlyDestructible,
Movable,
RegisterPassable,
TrivialRegisterPassable,
Writable
comptime membersβ
accum_typeβ
comptime accum_type = get_accum_type[a_type]()
Methodsβ
__init__β
__init__(*, cta_group: Int = 2, mma_shape: IndexList[3] = get_mma_shape[a_type, MatmulConfig[a_type, b_type, c_type, transpose_b].accum_type](), cluster_shape: IndexList[3] = Index[Int, Int, Int](2, 1, 1), AB_swapped: Bool = False, num_split_k: Int = 1, block_swizzle_size: Int = 0, raster_order: RasterOrder = RasterOrder.AlongM, k_group_size: Int = 1, prefetch_tiles_n: Int = 0, num_pipeline_stages: Optional[Int] = None, num_accum_pipeline_stages: Int = 2, num_clc_pipeline_stages: Int = 2, register_based_epilogue: Bool = True, extra_smem_per_stage: Int = 0, gemm_kind: GEMMKind = GEMMKind.GEMM) -> Self
swap_AB_typeβ
swap_AB_type(self) -> MatmulConfig[b_type, a_type, c_type, transpose_b]
Returns:
write_toβ
write_to[W: Writer](self, mut writer: W)
write_repr_toβ
write_repr_to(self, mut writer: T)
get_kernal_nameβ
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!