Before you begin
Make sure you have:- A Modular Cloud account.
- A Modular Cloud API key.
- Hermes Agent installed.
Hermes CLI or TUI
To configure Modular Cloud as a provider in Hermes in the terminal:-
Start Hermes with the command:
The
modeloption automatically runs the first time you run Hermes. Use the same steps to complete that initial process. - Select Custom endpoint.
-
Paste the base URL. Use
https://api.modular.com/v1for testing. - Paste your API key now, or skip if you want to configure it later.
- Select the Auto-detect API mode.
- Choose a model to become your default model. Hermes automatically integrates all available Modular Cloud models for you to switch to later.
- Click Enter to auto-detect the context length.
-
Enter a display name for the provider, such as
Modular Cloud.
/model command and select the
Modular Cloud model to use.
Hermes Desktop
To configure Modular Cloud as a provider in Hermes Desktop:- Open the Hermes Desktop app.
- Click the gear icon to open Settings.
- Open Providers > Custom Endpoints from the left navigation bar.
-
In the Add Endpoint form, fill out the following:
- Name:
Modular - Provider ID:
modular - Endpoint URL: The base URL, such as
https://api.modular.com/v1 - Default Model: A Modular Cloud model you have access to. Example:
minimax/minimax-m3 - API Key: Your Modular Cloud API key
- Name:
- Click Test to test the connection, then Save.
Update the config file
Both the Hermes CLI and Desktop share the same config file. To update settings for both:-
Open the
~/.hermes/config.yamlconfig file. -
Update the Modular Cloud custom provider section:
hermes config set. For example:
To see the complete list of provider configuration options, see LLM and Model
Providers
in the Hermes Agent documentation.