Mojo function

quantize_dynamic_scaled_async_kernel

quantize_dynamic_scaled_async_kernel[input_dtype: DType, input_cta_tile_layout: Layout, input_desc_layout: Layout, output_dtype: DType, output_cta_tile_layout: Layout, output_desc_layout: Layout, scales_dtype: DType, scales_tma_tile_layout: Layout, scales_desc_layout: Layout, input_swizzle_mode: TensorMapSwizzle, output_swizzle_mode: TensorMapSwizzle, scales_swizzle_mode: TensorMapSwizzle, SF_VECTOR_SIZE: UInt, NUM_PIPELINES_STAGES: UInt](input_tma_op: TMATensorTile[input_dtype, input_cta_tile_layout, input_desc_layout], output_tma_op: TMATensorTile[output_dtype, output_cta_tile_layout, output_desc_layout], scales_tma_op: TMATensorTile[scales_dtype, scales_tma_tile_layout, scales_desc_layout], tensor_sf: Float32)

Was this page helpful?

Thank you! We'll create more content like this.

Thank you for helping us improve!

😔 What went wrong?

Some code doesn’t work

It includes inaccurate information

It's missing information I need

It was difficult to understand

Other

Submit