For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).

Mojo function

calculate_symmetric_vector

def calculate_symmetric_vector[input_dtype: DType, simd_width: Int, output_bits: Int](data: SIMD[input_dtype, simd_width]) -> Tuple[SIMD[DType.uint8, simd_width], Scalar[input_dtype]]

Symmetrically quantizes the given SIMD vector data with input type input_dtype and simd_width elements, assuming we want the results to fit in an unsigned integer of size output_bits.

Parameters:

input_dtype (DType): The dtype of the input tensor.
simd_width (Int): The width of the SIMD input.
output_bits (Int): The bits we want to fit the unsigned integral result in.

Args:

data (SIMD[input_dtype, simd_width]): The input SIMD we want to quantize.

Returns:

Tuple[SIMD[DType.uint8, simd_width], Scalar[input_dtype]]: A vector of the quantized values. The associated scale factor.