Skip to content

docs(ops): document OrcaRouter as a LiteLLM model provider #2354

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Marc-oss-hub wants to merge 1 commit into
base: main
Choose a base branch
from
Open

docs(ops): document OrcaRouter as a LiteLLM model provider #2354

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions docs/src/content/docs/ops/entity_resolution.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -179,6 +179,9 @@ Uses the same litellm model-string format as [`LiteLLMEmbedder`](./litellm):
| Anthropic | `anthropic/claude-haiku-4-5` |
| Google (Gemini) | `gemini/gemini-2.0-flash` |
| Groq | `groq/llama-3.3-70b-versatile` |
| OrcaRouter | `openai/openai/gpt-5.5` |

For an OpenAI-compatible gateway such as [OrcaRouter](https://www.orcarouter.ai), use the `openai/` provider prefix with a namespaced model id (the outer `openai/` selects the protocol; the inner `openai/…` is the router's model id) and point `api_base` at `https://api.orcarouter.ai/v1`.

See the [LiteLLM docs](https://docs.litellm.ai/docs/providers) for the full list of 100+ supported providers.

Expand Down
19 changes: 19 additions & 0 deletions docs/src/content/docs/ops/litellm.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -181,6 +181,25 @@ embedder = LiteLLMEmbedder("ollama/nomic-embed-text", api_base="http://localhost
embedder = LiteLLMEmbedder("text-embedding-3-small")
```

### OrcaRouter

[OrcaRouter](https://www.orcarouter.ai) is an OpenAI-compatible routing gateway that exposes models from OpenAI, Anthropic, Google, DeepSeek, Qwen and others behind a single endpoint and API key. Route embeddings through it with the `openai/` provider prefix and a namespaced model id:

| Model | Model string |
|-------|-------------|
| Text Embedding 3 Small | `openai/openai/text-embedding-3-small` |
| Text Embedding 3 Large | `openai/openai/text-embedding-3-large` |

The outer `openai/` selects the OpenAI-compatible protocol; the inner `openai/…` is the router's namespaced model id. Pass the gateway's base URL and API key directly:

```python
embedder = LiteLLMEmbedder(
"openai/openai/text-embedding-3-small",
api_base="https://api.orcarouter.ai/v1",
api_key="sk-orca-...",
)
```

### Azure OpenAI

| Model | Model string |
Expand Down