Mojo struct
MHADecodeDispatchMetadata
@register_passable(trivial)
struct MHADecodeDispatchMetadata
Fields
- batch_size (
Int): - q_max_seq_len (
Int): - num_partitions (
Int): - max_cache_valid_length (
Int):
Implemented traits
AnyType,
Copyable,
ImplicitlyCopyable,
ImplicitlyDestructible,
Movable,
RegisterPassable,
TrivialRegisterPassable
comptime members
__copy_ctor_is_trivial
comptime __copy_ctor_is_trivial = True
__del__is_trivial
comptime __del__is_trivial = True
__move_ctor_is_trivial
comptime __move_ctor_is_trivial = True
Methods
from_runtime_values
static from_runtime_values[num_heads: Int, group: Int](batch_size: Int, q_max_seq_len: Int, max_cache_valid_length: Int, ctx: DeviceContext) -> Self
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!