For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).
Mojo struct
SplitKPartition
struct SplitKPartition[dtype: DType]
Fields
- ptr (
UnsafePointer[Scalar[SplitKPartition[dtype].accum_dtype], MutAnyOrigin]): - num_partitions_value (
UInt32): - max_num_partitions_value (
UInt32):
Implemented traits
AnyType,
Copyable,
ImplicitlyCopyable,
ImplicitlyDeletable,
MHAPartitionScheme,
Movable,
RegisterPassable,
TrivialRegisterPassable
comptime members
accum_dtype
comptime accum_dtype = dtype
do_partition
comptime do_partition = True
Methods
__init__
def __init__(ptr: UnsafePointer[Scalar[Self.accum_dtype], MutAnyOrigin], num_partitions_value: UInt32, max_num_partitions_value: UInt32) -> Self
num_partitions
max_num_partitions
get_exp_sum_qk_max_pointer
def get_exp_sum_qk_max_pointer(self) -> UnsafePointer[Scalar[Self.accum_dtype], MutAnyOrigin]
Returns:
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!