Mojo struct
DecodeKVProducer
@register_passable(trivial)
struct DecodeKVProducer[dtype: DType, config: MLA_SM100_Decode_Config]
Fields
- pipe (
DecodeKVProducer[dtype, config].KVPipeType): - smem (
UnsafePointer[Scalar[dtype], MutAnyOrigin, address_space=AddressSpace.SHARED]):
Implemented traits
AnyType,
Copyable,
ImplicitlyCopyable,
ImplicitlyDestructible,
Movable
comptime members
__copyinit__is_trivial
comptime __copyinit__is_trivial = True
__del__is_trivial
comptime __del__is_trivial = True
__moveinit__is_trivial
comptime __moveinit__is_trivial = True
kv_stage_bytes
comptime kv_stage_bytes = (DecodeKVProducer[dtype, config].kv_stage_elems * size_of[dtype]())
kv_stage_elems
comptime kv_stage_elems = (config * config)
KVPipeType
comptime KVPipeType = KVPipelineGeneric[config.num_kv_stages, 1, 1, 2]
Methods
__init__
__init__(pipe: KVPipelineGeneric[config.num_kv_stages, 1, 1, 2], smem: UnsafePointer[Scalar[dtype], MutAnyOrigin, address_space=AddressSpace.SHARED]) -> Self
init
init(self)
stage_base_ptr
stage_base_ptr[*, mma_stage: Int = 0](self) -> UnsafePointer[Scalar[dtype], MutAnyOrigin, address_space=AddressSpace.SHARED]
Returns:
stage_index
producer_mbar
producer_mbar[*, mma_stage: Int = 0](self) -> MBarType
Returns:
MBarType
acquire
acquire[*, mma_stage: Int = 0](self)
commit_step
commit_step(mut self)
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!