For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).

Mojo struct

DecodeKVConsumer

struct DecodeKVConsumer[dtype: DType, config: MLA_SM100_Decode_Config, num_producer: Int = Int(1)]

Fields

pipe (DecodeKVConsumer[dtype, config, num_producer].KVPipeType):
smem (UnsafePointer[Scalar[dtype], MutAnyOrigin, address_space=AddressSpace.SHARED]):

Implemented traits

AnyType, Copyable, ImplicitlyCopyable, ImplicitlyDeletable, Movable, RegisterPassable, TrivialRegisterPassable

`comptime` members

`kv_stage_elems`

comptime kv_stage_elems = (config * config)

`KVPipeType`

comptime KVPipeType = KVPipelineGeneric[config.num_kv_stages, Int(1), num_producer, Int(2)]

Methods

`init`

def __init__(pipe: KVPipelineGeneric[config.num_kv_stages, Int(1), num_producer, Int(2)], smem: UnsafePointer[Scalar[dtype], MutAnyOrigin, address_space=AddressSpace.SHARED]) -> Self

`stage_base_ptr`

def stage_base_ptr[*, qk_stage: Int = Int(0)](self) -> UnsafePointer[Scalar[dtype], MutAnyOrigin, address_space=AddressSpace.SHARED]

Returns:

UnsafePointer[Scalar[dtype], MutAnyOrigin, address_space=AddressSpace.SHARED]

`stage_index`

def stage_index[*, qk_stage: Int = Int(0)](self) -> UInt32

Returns:

UInt32

`wait`

def wait[*, qk_stage: Int = Int(0)](self)

`release`

def release[*, qk_stage: Int = Int(0)](mut self, e: Int32)

Fields​

Implemented traits​

comptime members​

kv_stage_elems​

KVPipeType​

Methods​

__init__​

stage_base_ptr​

stage_index​

wait​

release​