For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).
Python class
Allreduce
Allreduce
class max.nn.Allreduce(num_accelerators)
Bases: Module
Layer to perform allreduce operation with automatic implementation selection.
Automatically chooses between peer-to-peer optimized allreduce and naive device-to-device transfer based on accelerator connectivity.
-
Parameters:
-
num_accelerators (int) – Number of accelerators participating in the allreduce operation
Initialize the Allreduce layer with a specified number of accelerators.
-
Parameters:
-
num_accelerators (int) – Number of accelerators to use for allreduce
-
Raises:
-
ValueError – If num_accelerators is less than 1
devices
devices: list[Accelerator]
List of accelerators involved in the allreduce operation.
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!