Mojo struct
Flops
@register_passable
struct Flops
Represents floating point operations per second for different precisions.
This struct stores FLOPS values for various precision formats including FP8, FP16, TF32, FP64, and integer operations.
Fields
- fp8 (
SIMD[float64, 1]): FP8 operations per second in TFLOPS. - fp16 (
SIMD[float64, 1]): FP16 operations per second in TFLOPS. - tf32 (
SIMD[float64, 1]): TF32 operations per second in TFLOPS. - fp64 (
SIMD[float64, 1]): FP64 operations per second in TFLOPS. - i8 (
SIMD[float64, 1]): INT8 operations per second in TOPS. - i4 (
SIMD[float64, 1]): INT4 operations per second in TOPS.
Implemented traits
AnyType,
Copyable,
ExplicitlyCopyable,
Movable,
UnknownDestructibility,
Writable
Methods
__init__
__init__(*, fp16: SIMD[float64, 1], i8: SIMD[float64, 1], i4: SIMD[float64, 1], fp8: SIMD[float64, 1] = __init__[__mlir_type.!pop.int_literal](0), tf32: SIMD[float64, 1] = __init__[__mlir_type.!pop.int_literal](0), fp64: SIMD[float64, 1] = __init__[__mlir_type.!pop.int_literal](0)) -> Self
Initializes a Flops instance with performance metrics.
Args:
- fp16 (
SIMD[float64, 1]): FP16 operations per second in TFLOPS. - i8 (
SIMD[float64, 1]): INT8 operations per second in TOPS. - i4 (
SIMD[float64, 1]): INT4 operations per second in TOPS. - fp8 (
SIMD[float64, 1]): FP8 operations per second in TFLOPS (default: 0). - tf32 (
SIMD[float64, 1]): TF32 operations per second in TFLOPS (default: 0). - fp64 (
SIMD[float64, 1]): FP64 operations per second in TFLOPS (default: 0).
write_to
write_to[W: Writer](self, mut writer: W)
Writes FLOPS information to a writer.
This method formats and outputs all non-zero FLOPS metrics to the provided writer. FP8 and FP16 values are written together, while TF32 and FP64 are only written if they have non-zero values. INT8 and INT4 metrics are always written.
Parameters:
- W (
Writer): The type of writer to use for output. Must implement the Writer trait.
Args:
- writer (
W): The writer object that implements the Writer trait, used to output the formatted FLOPS information.
__str__
__str__(self) -> String
Returns a string representation of the FLOPS metrics.
This method converts all the FLOPS metrics into a human-readable string format by utilizing the write_to method with a String writer.
Returns:
A formatted string containing all relevant FLOPS values, with each metric on its own line and properly labeled with its precision type.
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!