Skip to content

[codex] Add B.AI LLM connection support#90

Draft
aquadrop wants to merge 1 commit into
lm-sys:mainfrom
aquadrop:codex/add-bai-llm-support
Draft

[codex] Add B.AI LLM connection support#90
aquadrop wants to merge 1 commit into
lm-sys:mainfrom
aquadrop:codex/add-bai-llm-support

Conversation

@aquadrop

Copy link
Copy Markdown

Summary

  • Add a bai/ model prefix for routing requests to B.AI's OpenAI-compatible LLM API.
  • Map routed B.AI models to LiteLLM's openai/ provider with B.AI API defaults from BAI_API_KEY and optional BAI_API_BASE.
  • Document B.AI setup and add mocked unit coverage for sync, async, explicit overrides, and non-B.AI behavior.

Validation

  • python -m pytest routellm/tests/test_bai_support.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant