Mojo struct

SplitKPartition

@register_passable(trivial) struct SplitKPartition[dtype: DType]

Fields

ptr (UnsafePointer[Scalar[SplitKPartition[dtype].accum_dtype]]):
num_partitions_value (UInt32):

Implemented traits

AnyType, Copyable, ImplicitlyCopyable, MHAPartitionScheme, Movable, UnknownDestructibility

Aliases

`copyinitis_trivial`

alias __copyinit__is_trivial = True

`delis_trivial`

alias __del__is_trivial = True

`moveinitis_trivial`

alias __moveinit__is_trivial = True

`accum_dtype`

alias accum_dtype = dtype

`do_partition`

alias do_partition = True

Methods

`init`

__init__(ptr: UnsafePointer[Scalar[SplitKPartition[dtype].accum_dtype]], num_partitions_value: UInt32) -> Self

`num_partitions`

num_partitions(self) -> UInt32

Returns:

UInt32

`get_exp_sum_qk_max_pointer`

get_exp_sum_qk_max_pointer(self) -> UnsafePointer[Scalar[SplitKPartition[dtype].accum_dtype]]

Returns:

UnsafePointer

Fields​

Implemented traits​

Aliases​

__copyinit__is_trivial​

__del__is_trivial​

__moveinit__is_trivial​

accum_dtype​

do_partition​

Methods​

__init__​

num_partitions​

get_exp_sum_qk_max_pointer​