For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).
Mojo struct
block_Q6_K
struct block_Q6_K
Fields
- q_bits_lo (
InlineArray[UInt8, 128]): - q_bits_hi (
InlineArray[UInt8, 64]): - q_scales (
InlineArray[Int8, 16]): - base_scale (
Float16):
Implemented traits
comptime members
group_count
comptime group_count = 16
group_size
comptime group_size = 16
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!