For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).
Mojo function
dispatch_qslice_conv3d_sm100
def dispatch_qslice_conv3d_sm100[input_type: DType, filter_type: DType, output_type: DType, //, filter_is_fcrs: Bool = False, maybe_epilogue_func: Optional[def[dtype: DType, rank: Int, width: SIMDLength, alignment: Int = Int(1)](IndexList[rank], SIMD[dtype, width]) capturing thin -> None] = None](input: TileTensor[input_type, Storage=input.Storage, address_space=input.address_space, linear_idx_type=input.linear_idx_type], filter: TileTensor[filter_type, Storage=filter.Storage, address_space=filter.address_space, linear_idx_type=filter.linear_idx_type], output: TileTensor[output_type, Storage=output.Storage, address_space=output.address_space, linear_idx_type=output.linear_idx_type], stride: IndexList[Int(3)], dilation: IndexList[Int(3)], symmetric_padding: IndexList[Int(3)], num_groups: Int, ctx: DeviceContext) -> Bool
Try to dispatch a 3-D conv as Q Γ SM100 2-D conv calls with a dedicated fp32 accumulator.
Parameters:
- βinput_type (
DType): The element type ofinput(inferred). The gate requiresDType.bfloat16. - βfilter_type (
DType): The element type offilter(inferred). - βoutput_type (
DType): The element type ofoutput(inferred). The gate requiresDType.bfloat16. - βfilter_is_fcrs (
Bool): Whetherfilteris laid out as FCQRS rather than QRSCF (defaults toFalse). The gate requiresFalsebecause a fixed-qFCQRS slab is non-contiguous. - βmaybe_epilogue_func (
Optional[def[dtype: DType, rank: Int, width: SIMDLength, alignment: Int = Int(1)](IndexList[rank], SIMD[dtype, width]) capturing thin -> None]): Optional 5-D elementwise epilogue fused into the final fp32-to-output_typewrite (defaults toNone).
Args:
- βinput (
TileTensor[input_type, Storage=input.Storage, address_space=input.address_space, linear_idx_type=input.linear_idx_type]): Rank-5 input tensor in NDHWC layout. - βfilter (
TileTensor[filter_type, Storage=filter.Storage, address_space=filter.address_space, linear_idx_type=filter.linear_idx_type]): Rank-5 filter tensor in QRSCF layout, shaped[Q, R, S, C_in, C_out]. - βoutput (
TileTensor[output_type, Storage=output.Storage, address_space=output.address_space, linear_idx_type=output.linear_idx_type]): Rank-5 mutable output tensor in NDHWC layout. - βstride (
IndexList[Int(3)]): Per-axis stride for the(D, H, W)dimensions. The gate requires(1, 1, 1). - βdilation (
IndexList[Int(3)]): Per-axis dilation for the(D, H, W)dimensions. The gate requires(1, 1, 1). - βsymmetric_padding (
IndexList[Int(3)]): Symmetric padding for the(D, H, W)dimensions. Temporal (D) padding must be zero. - βnum_groups (
Int): Number of convolution groups. The gate requires1. - βctx (
DeviceContext): Device context used for buffer allocation and kernel launches.
Returns:
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!