Skip to main content
Each dedicated deployment runs a single model and exposes a private endpoint that only your organization can access. To set up a dedicated deployment, contact us.
You don’t have to create a dedicated deployment to use models on Modular Cloud. We also provide several models on shared endpoints that you can use with just an API key.

When to use a dedicated deployment

A dedicated deployment gives you reserved, isolated capacity. Consider a dedicated deployment when you want to:
  • Run a model that isn’t available as a shared endpoint.
  • Tune inference cost to your own priorities.
  • Guarantee that users in your organization have their own pool of resources and capacity.

Pricing

Dedicated deployments are available on the Enterprise plan.