For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).
Mojo struct
SplitKWorkspace
struct SplitKWorkspace[num_splits: Int]
Pre-allocated scratch for repeated split-K launches.
Allocate once per (M, N) and pass to amd_4wave_split_k_matmul.
The buffer must hold num_splits * M * N float32 elements.
Parameters
- num_splits (
Int): Number of K-splits the workspace must hold.
Fields
- scratch (
DeviceBuffer[DType.float32]): Backing float32 device buffer of sizenum_splits * elems_per_split.
Implemented traits
AnyType,
Copyable,
ImplicitlyCopyable,
ImplicitlyDeletable,
Movable
Methods
__init__
def __init__(out self, ctx: DeviceContext, elems_per_split: Int)
Allocates the per-split scratch buffer on the device.
Args:
- ctx (
DeviceContext): Device context used to allocate the buffer. - elems_per_split (
Int): Number of float32 elements per K-split (typicallyM * N).
Raises:
An error if device allocation fails.
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!