For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).
Python class
MemoryStats
MemoryStats
class max.profiler.gpu.MemoryStats(total_bytes, free_bytes, used_bytes, reserved_bytes)
Bases: Struct
Detailed GPU memory usage statistics including total, free, used, and reserved memory.
This class provides comprehensive memory information for a GPU, allowing developers to monitor memory consumption and identify potential memory bottlenecks during model inference or training.
free_bytes
free_bytes: int
Currently available GPU memory in bytes.
reserved_bytes
Memory reserved by the driver, if available from the GPU vendor.
total_bytes
total_bytes: int
Total GPU memory capacity in bytes.
used_bytes
used_bytes: int
Currently allocated GPU memory in bytes.
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!