Benchmark MAX Serve on an NVIDIA A100 GPU
Learn how to use our benchmarking script to measure the performance of MAX Serve.
6 docs tagged with "llm"
View all tagsDeploy a PyTorch model from Hugging Face
Learn how to deploy PyTorch models from Hugging Face using a MAX Docker container
Deploy Llama 3 on GPU with MAX Serve
Learn how to deploy MAX pipelines to cloud
Deploy Llama 3 on GPU-powered Kubernetes clusters
Create a GPU-enabled Kubernetes cluster with the cloud provider of your choice and deploy Llama 3.1 with MAX Serve using Helm.
Generate image descriptions with Llama 3.2 Vision
Learn how to deploy Llama 3.2 Vision on GPU with MAX to generate image descriptions
Serverless GPU inference on Google Cloud Run
Learn how to deploy Llama 3 on Google Cloud Run using MAX for serverless GPU inferencing