For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).

Mojo function

shmem_barrier_all_on_stream

shmem_barrier_all_on_stream(stream: DeviceStream)

Mechanism for synchronizing all PEs at once. This routine blocks the calling PE until all PEs have called nvshmem_barrier_all. In a multithreaded NVSHMEM program, only the calling thread is blocked, however, it may not be called concurrently by multiple threads in the same PE.

Prior to synchronizing with other PEs, this function ensures completion of all previously issued memory stores and remote memory updates issued NVSHMEMAMOs and RMA routine calls such as shmem_put, shmem_g, etc.

Args:

stream (DeviceStream): The stream to perform the barrier on.

Raises:

If the barrier operation fails.