Mojo struct
KVLoad2CvtConsumer
@register_passable(trivial)
struct KVLoad2CvtConsumer[dtype: DType, config: MLA_SM100_Decode_Config]
Fields
- pipe (
KVLoad2CvtConsumer[dtype, config].PipeT): - smem_upper_fp8 (
UnsafePointer[Scalar[dtype], MutAnyOrigin, address_space=AddressSpace.SHARED]):
Implemented traits
AnyType,
Copyable,
ImplicitlyCopyable,
ImplicitlyDestructible,
Movable,
TrivialRegisterType
comptime members
__copyinit__is_trivial
comptime __copyinit__is_trivial = True
__del__is_trivial
comptime __del__is_trivial = True
__moveinit__is_trivial
comptime __moveinit__is_trivial = True
bf16_stage_elems
comptime bf16_stage_elems = (config * config)
fp8_stage_stride_elems
comptime fp8_stage_stride_elems = (2 * KVLoad2CvtConsumer[dtype, config].bf16_stage_elems)
PipeT
comptime PipeT = KVPipelineGeneric[config.num_kv_stages, 1, 1, (WARPGROUP_SIZE + 2)]
Methods
__init__
__init__(pipe: KVPipelineGeneric[config.num_kv_stages, 1, 1, (WARPGROUP_SIZE + 2)], smem_upper_fp8: UnsafePointer[Scalar[dtype], MutAnyOrigin, address_space=AddressSpace.SHARED]) -> Self
stage_base_ptr
stage_base_ptr(self) -> UnsafePointer[Scalar[dtype], MutAnyOrigin, address_space=AddressSpace.SHARED]
Returns:
wait
wait(self)
release_all
release_all(mut self)
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!