Provider Matrix
Nimi Runtime routes AI requests through a unified API. Use this page as the single source for provider capability coverage and rollout status.
For onboarding and quickstart, prefer the high-level targeting surface:
nimi run "<prompt>"for the local default text targetnimi run "<prompt>" --provider <provider>for a provider default cloud targetnimi run "<prompt>" --cloudfor the saved machine default cloud target
This matrix documents advanced provider-qualified prefixes exposed by lower-level runtime and SDK surfaces.
Status Legend
GA: available now for production usage in current runtime contractsBeta: available now with limited or policy-gated modalitiesPlanned: tracked for future delivery, not available in current runtime contracts
Capability Legend
✅available now-not available in current runtime contract🟡planned
Local Engines
| Engine | SDK Prefix | Status | Text | Embed | Image | Video | TTS | STT | Notes |
|---|---|---|---|---|---|---|---|---|---|
| LocalAI | local/ | GA | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | Full local multimodal routing |
| Nexa | local/ | Beta | ✅ | ✅ | ✅ | - | ✅ | ✅ | Video intentionally blocked by nexa.video.unsupported (AI_ROUTE_UNSUPPORTED) |
Cloud Providers
| Provider | SDK Prefix | Status | Text | Embed | Image | Video | TTS | STT | Notes |
|---|---|---|---|---|---|---|---|---|---|
| OpenAI | openai/ | GA | ✅ | ✅ | - | - | - | - | |
| Anthropic | anthropic/ | GA | ✅ | - | - | - | - | - | |
| Google Gemini | gemini/ | GA | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | |
| DeepSeek | deepseek/ | GA | ✅ | - | - | - | - | - | |
| OpenRouter | openrouter/ | GA | ✅ | - | - | - | - | - | |
| OpenAI-Compatible (BYO endpoint) | openai_compatible/ | GA | ✅ | - | - | - | - | - | Supports Ollama, vLLM, LM Studio, LiteLLM, Xinference, and similar endpoints |
| Alibaba DashScope | dashscope/ | GA | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | |
| Volcengine ARK (Doubao) | volcengine/ | GA | ✅ | ✅ | ✅ | ✅ | - | - | |
| Volcengine OpenSpeech | volcengine_openspeech/ | GA | - | - | - | - | ✅ | ✅ | |
| MiniMax | minimax/ | GA | ✅ | - | ✅ | ✅ | ✅ | ✅ | |
| Kimi (Moonshot) | kimi/ | GA | ✅ | - | ✅ | - | ✅ | ✅ | |
| GLM (Zhipu) | glm/ | GA | ✅ | - | ✅ | ✅ | ✅ | ✅ | |
| Azure OpenAI | azure/ | GA | ✅ | ✅ | - | - | - | - | |
| Mistral AI | mistral/ | GA | ✅ | ✅ | - | - | - | - | |
| Groq | groq/ | Beta | ✅ | - | - | - | - | 🟡 | STT planned |
| xAI (Grok) | xai/ | GA | ✅ | - | - | - | - | - | |
| Baidu Qianfan (ERNIE) | qianfan/ | Beta | ✅ | ✅ | 🟡 | - | 🟡 | 🟡 | |
| Tencent Hunyuan | hunyuan/ | Beta | ✅ | ✅ | 🟡 | 🟡 | 🟡 | 🟡 | |
| iFlytek Spark | spark/ | Beta | ✅ | - | - | - | 🟡 | 🟡 | |
| AWS Bedrock | TBD | Planned | 🟡 | 🟡 | 🟡 | - | - | - | |
| Cohere | TBD | Planned | 🟡 | 🟡 | - | - | - | - | |
| Together AI | TBD | Planned | 🟡 | 🟡 | 🟡 | - | - | - | |
| Replicate | TBD | Planned | 🟡 | - | 🟡 | 🟡 | - | - | |
| ElevenLabs | TBD | Planned | - | - | - | - | 🟡 | 🟡 | |
| Baichuan AI | TBD | Planned | 🟡 | 🟡 | - | - | - | - | |
| Yi (01.AI) | TBD | Planned | 🟡 | - | - | - | - | - | |
| Step AI | TBD | Planned | 🟡 | - | 🟡 | 🟡 | - | - | |
| Perplexity AI | TBD | Planned | 🟡 | - | - | - | - | - | |
| Stability AI | TBD | Planned | - | - | 🟡 | 🟡 | - | - | |
| AssemblyAI | TBD | Planned | - | - | - | - | - | 🟡 | |
| Runway | TBD | Planned | - | - | - | 🟡 | - | - |
Validation In Your Environment
bash
nimi provider list
nimi doctor
nimi provider test gemini
nimi run "Hello from Nimi" --provider gemini
nimi provider set gemini --api-key-env NIMI_RUNTIME_CLOUD_GEMINI_API_KEY --default
nimi run "Hello from Nimi" --cloudRunnable provider examples: examples/sdk/providers/