Mojo struct

MHADecodeDispatchMetadata

struct MHADecodeDispatchMetadata

Fields

• ​batch_size (Int):
• ​q_max_seq_len (Int):
• ​num_partitions (Int):
• ​max_cache_valid_length (Int):

Implemented traits

AnyType, Copyable, ImplicitlyCopyable, ImplicitlyDestructible, Movable, RegisterPassable, TrivialRegisterPassable

Methods

from_runtime_values

static from_runtime_values[num_heads: Int, group: Int](batch_size: Int, q_max_seq_len: Int, max_cache_valid_length: Int, ctx: DeviceContext) -> Self

Was this page helpful?

Thank you! We'll create more content like this.

Thank you for helping us improve!

😔 What went wrong?

Some code doesn’t work

It includes inaccurate information

It's missing information I need

It was difficult to understand

Other

Submit