You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Adds LiteLLM as a plugin. Sets LITELLM_BASE_URL (and optionally LITELLM_API_KEY) to connect. Models are synced from the proxy's /v1/models endpoint and enriched with per-model metadata from /model/info.
Files changed:
src/plugin/litellm/litellm.ts: Plugin with provider.models hook (model sync) and auth hook (API key)
src/plugin/litellm/models.ts: Model fetching from /v1/models + /model/info metadata enrichment
src/plugin/index.ts: Registered LiteLLM in internal plugins
Why related: Provider integration feature that may have overlapping scope with adding a new gateway provider.
The most significant is PR #14468 - verify if it's the predecessor/duplicate of the current work or if it's a separate issue being addressed by PR #29937.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Issue for this PR
Closes #29935
Type of change
What does this PR do?
Adds LiteLLM as a plugin. Sets
LITELLM_BASE_URL(and optionallyLITELLM_API_KEY) to connect. Models are synced from the proxy's/v1/modelsendpoint and enriched with per-model metadata from/model/info.Files changed:
src/plugin/litellm/litellm.ts: Plugin withprovider.modelshook (model sync) andauthhook (API key)src/plugin/litellm/models.ts: Model fetching from/v1/models+/model/infometadata enrichmentsrc/plugin/index.ts: Registered LiteLLM in internal pluginssrc/provider/provider.ts: Removed built-in provider code, added generic plugin provider seedingpackages/core/src/provider.ts:litellmprovider IDsprite.svg/types.ts: Provider iconen.ts/settings-providers.tsx/dialog-select-provider.tsx: UI strings and notesLITELLM_BASE_URLhttp://localhost:4000)LITELLM_API_KEYRelated: #29308, #6231, #14468
How did you verify your code works?
LITELLM_BASE_URL=http://localhost:4000env varbun dev), LiteLLM models auto-discovered from/v1/modelsand appear in model picker/model/infometadata enrichment (token limits, costs)Screenshots / recordings
ceb2-3aa7-47fd-b86f-e27af97bfe24-2.mp4
Checklist