For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).

Mojo function

q4_k_dequantize_impl

def q4_k_dequantize_impl(input_tt: TileTensor[DType.uint8, Storage=input_tt.Storage, linear_idx_type=input_tt.linear_idx_type], output_tt: TileTensor[DType.float32, Storage=output_tt.Storage, linear_idx_type=output_tt.linear_idx_type])

Dequantizes a Q4_K encoded tensor into a float32 output tensor.

Args:

input_tt (TileTensor[DType.uint8, Storage=input_tt.Storage, linear_idx_type=input_tt.linear_idx_type]): The input tensor containing Q4_K encoded data.
output_tt (TileTensor[DType.float32, Storage=output_tt.Storage, linear_idx_type=output_tt.linear_idx_type]): The output tensor to write dequantized float32 values to.