For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
The max command line tool runs and benchmarks MAX pipelines from one
binary. Use max serve to host an OpenAI-compatible endpoint, max generate
or max encode to run a model directly, max benchmark to load-test a
running server, max warm-cache to compile and cache a model ahead of
deployment, and max list to discover the architectures MAX supports.
To install the max CLI, install the modular package as shown
in the install guide.
max
Usage
max [OPTIONS] COMMAND [ARGS]...Options
-
--log-level <log_level>Set logging level explicitly (ignored if --verbose or --quiet is used).
-
Options:
-
DEBUG | INFO | WARNING | ERROR
-
-
--versionShow the MAX version and exit.
Commands
-
Run benchmark tests on a serving model.
-
Encode text input into model embeddings.
-
Generate text using the specified model.
-
list:List available pipeline configurations and...
-
Start a model serving endpoint for inference.
-
Load and compile the model to prepare caches.
-
Compile the eager interpreter's...
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!