For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).
Mojo struct
Pack
struct Pack[MaskType: MHAMask, SchedulerType: MHATileScheduler, ValidLengthType: OptionalPointer, SinkType: OptionalPointer, KVRowOffsetsType: OptionalPointer, MaxSeqLenType: OptionallyStaticInt, PartitionType: MHAPartitionScheme]
Fields
- mask (
MaskType): - scheduler (
SchedulerType): - valid_length (
ValidLengthType): - sink_weights (
SinkType): - kv_input_row_offsets (
KVRowOffsetsType): - max_seq_len (
MaxSeqLenType): - partition (
PartitionType):
Implemented traits
AnyType,
Copyable,
DevicePassable,
ImplicitlyCopyable,
ImplicitlyDeletable,
Movable,
RegisterPassable,
TrivialRegisterPassable
comptime members
device_type
comptime device_type = Pack[MaskType, SchedulerType, ValidLengthType, SinkType, KVRowOffsetsType, MaxSeqLenType, PartitionType]
Methods
__init__
def __init__(mask: MaskType, scheduler: SchedulerType, valid_length: ValidLengthType, sink_weights: SinkType, kv_input_row_offsets: KVRowOffsetsType, max_seq_len: MaxSeqLenType, partition: PartitionType) -> Self
get_type_name
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!