Mojo module

fp4_utils

Aliases

E2M1_TO_FLOAT32

comptime E2M1_TO_FLOAT32 = SIMD[DType.float32, 16](0, 0.5, 1, 1.5, 2, 3, 4, 6, -0.0, -0.5, -1, -1.5, -2, -3, -4, -6, Tuple[]())

MXFP4_SF_DTYPE

comptime MXFP4_SF_DTYPE = DType.float8_e8m0fnu

MXFP4_SF_VECTOR_SIZE

comptime MXFP4_SF_VECTOR_SIZE = 32

MXFP8_SF_DTYPE

comptime MXFP8_SF_DTYPE = DType.float8_e8m0fnu

MXFP8_SF_VECTOR_SIZE

comptime MXFP8_SF_VECTOR_SIZE = 32

NVFP4_SF_DTYPE

comptime NVFP4_SF_DTYPE = DType.float8_e4m3fn

NVFP4_SF_VECTOR_SIZE

comptime NVFP4_SF_VECTOR_SIZE = 16

SF_ATOM_K

comptime SF_ATOM_K = 4

SF_ATOM_M

comptime SF_ATOM_M = Tuple[Int, Int](VariadicPack[True, True, origin_of(), Copyable & Movable, Int, Int](32, 4))

SF_MN_GROUP_SIZE

comptime SF_MN_GROUP_SIZE = ((load_from_mem SF_ATOM_M.__getitem__[Int, Int, 0]()) * (load_from_mem SF_ATOM_M.__getitem__[Int, Int, 1]()))

Functions

• ​cast_f4e2m1x2_to_fp16x2:
• ​cast_fp32_to_fp4e2m1:
• ​cast_fp_to_fp4e2m1:
• ​cast_uint32_to_fp4e2m1:

Was this page helpful?

Thank you! We'll create more content like this.

Thank you for helping us improve!

😔 What went wrong?

Some code doesn’t work

It includes inaccurate information

It's missing information I need

It was difficult to understand

Other

Submit