For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).

Python class

Collective

`Collective`

class max.experimental.sharding.Collective(value, names=<not given>, *values, module=None, qualname=None, type=None, start=1, boundary=None)

source

Bases: Enum

The collectives the cost model understands.

A Placement.transition_to() return value must be one of these. Custom Placement subclasses that return anything else are reported as infeasible by the cost model.

`ALLGATHER`

ALLGATHER = 'allgather'

source

`ALLREDUCE`

ALLREDUCE = 'allreduce'

source

`ALL_TO_ALL`

ALL_TO_ALL = 'all_to_all'

source

`INFEASIBLE`

INFEASIBLE = 'infeasible'

source

`LOCAL_SLICE`

LOCAL_SLICE = 'local_slice'

source

`NOOP`

NOOP = 'noop'

source

`REDUCE_SCATTER`

REDUCE_SCATTER = 'reduce_scatter'

source

Collective​

ALLGATHER​

ALLREDUCE​

ALL_TO_ALL​

INFEASIBLE​

LOCAL_SLICE​

NOOP​

REDUCE_SCATTER​