For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo module

shard_and_stack

Implements shard-and-stack: shards a tensor across devices and stacks the shards into a higher-rank output.

Functions

• ​shard_and_stack: Shard weight tensors across multiple devices for tensor parallelism.