Mojo function

block_scales_interleave

block_scales_interleave[scales_dtype: DType, //, *, SF_VECTOR_SIZE: Int, target: StringSlice[StaticConstantOrigin] = "cpu"](output_scales_device: NDBuffer[scales_dtype, MutAnyOrigin, output_scales_device.shape, DimList.create_unknown[5]()], input_scales_device: NDBuffer[scales_dtype, ImmutAnyOrigin, input_scales_device.shape, DimList.create_unknown[2]()], ctx: DeviceContext)

NDBuffer overload of block_scales_interleave. Converts to TileTensor and delegates.

block_scales_interleave[scales_dtype: DType, //, *, SF_VECTOR_SIZE: Int, target: StringSlice[StaticConstantOrigin] = "cpu"](output_scales_device: TileTensor[scales_dtype, output_scales_device.LayoutType, output_scales_device.origin, linear_idx_type=output_scales_device.linear_idx_type, element_size=output_scales_device.element_size], input_scales_device: TileTensor[scales_dtype, input_scales_device.LayoutType, input_scales_device.origin, linear_idx_type=input_scales_device.linear_idx_type, element_size=input_scales_device.element_size], ctx: DeviceContext)

Was this page helpful?

Thank you! We'll create more content like this.

Thank you for helping us improve!

😔 What went wrong?

Some code doesn’t work

It includes inaccurate information

It's missing information I need

It was difficult to understand

Other

Submit