Connect with Oh My Pi

​

Before you begin

• A Modular Cloud API key.
• Oh My Pi 18.15.0 or later installed.

​

Connect to the Modular provider

1. Start Oh My Pi:
   omp
   
2. Run the /login modular command and paste your API key. You can skip this step if you set the MODULAR_API_KEY environment variable before you start Oh My Pi.
3. Run the /model command and choose a Modular Cloud model.

​

Connect a dedicated deployment

1. Open your deployment and copy its Dedicated Endpoint and Model ID.
2. Export your API key as an environment variable:
   macOS/Linux

   Windows

   export MODULAR_API_KEY="YOUR_API_KEY"
   
3. Open (or create) the ~/.omp/agent/models.yml config file and add a provider for your deployment:
   models.yml

   providers:
     modular-dedicated:
       baseUrl: https://YOUR_ORG_NAME.api.modular.com/v1
       api: openai-completions
       apiKey: MODULAR_API_KEY
       models:
         - id: moonshotai/Kimi-K2.7-Code
           name: Kimi K2.7 Code
   
   In baseUrl, paste the dedicated endpoint you copied in step 1 with /v1 appended. Then replace the model ID with your deployment’s model ID. Modular Cloud supports the OpenAI chat completions API, so set api to openai-completions. Avoid naming the provider modular. That ID belongs to the built-in Modular provider, so your settings would override it instead of adding a separate provider.
4. Start Oh My Pi, run the /model command, and select your deployment’s model.