Skip to content

feat: add options for adjusting LLM URL option#9964

Merged
Ali-Sab merged 1 commit into
Kong:developfrom
Ali-Sab:feat/llm-url-options
Jun 2, 2026
Merged

feat: add options for adjusting LLM URL option#9964
Ali-Sab merged 1 commit into
Kong:developfrom
Ali-Sab:feat/llm-url-options

Conversation

@Ali-Sab
Copy link
Copy Markdown
Contributor

@Ali-Sab Ali-Sab commented May 26, 2026

Add ability to change parameters and use API key for self-hosted LLMs like from Ollama, or other cloud providers that have OpenAI compatible endpoints.

@Ali-Sab Ali-Sab force-pushed the feat/llm-url-options branch 7 times, most recently from 110b6ab to 075a778 Compare June 1, 2026 14:04
@Ali-Sab Ali-Sab marked this pull request as ready for review June 1, 2026 16:15
Copilot AI review requested due to automatic review settings June 1, 2026 16:15
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds richer configuration for the “LLM URL” backend so users can use OpenAI-compatible/self-hosted endpoints (e.g., Ollama) with an optional API token and adjustable sampling parameters, and persists those settings through config storage and UI.

Changes:

  • Extend the LLM URL settings UI with API token + “Advanced Options” (temperature/topP/maxTokens) and persist them.
  • Add URL-backend maxTokens support in the main config service + tests.
  • Add helper utilities + unit tests for URL settings payloads and activation-state logic, plus smoke tests for persistence/deactivation.

Reviewed changes

Copilot reviewed 8 out of 8 changed files in this pull request and generated 5 comments.

Show a summary per file
File Description
packages/insomnia/src/ui/components/settings/llms/url.tsx Adds API token + advanced parameter UI and uses new URL utilities when loading models/activating.
packages/insomnia/src/ui/components/settings/llms/url-utils.ts Introduces URL helper utilities (schema, payload builders, activation disable logic, auth headers).
packages/insomnia/src/ui/components/settings/llms/url-utils.test.ts Adds Vitest coverage for URL utilities.
packages/insomnia/src/ui/components/settings/ai-settings.tsx Minor formatting-only arrow function cleanup.
packages/insomnia/src/main/llm-config-service.ts Adds maxTokens to LLMConfig and parses it from plugin storage.
packages/insomnia/src/main/ipc/main.ts Changes how MCP sampling request config is merged with stored model config.
packages/insomnia/src/main/tests/llm-config-service.test.ts Adds tests covering URL numeric option parsing/saving.
packages/insomnia-smoke-test/tests/smoke/preferences-interactions.test.ts Adds smoke tests for URL advanced option persistence and backend deactivation.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread packages/insomnia/src/ui/components/settings/llms/url.tsx Outdated
Comment thread packages/insomnia/src/ui/components/settings/llms/url.tsx
Comment thread packages/insomnia/src/ui/components/settings/llms/url.tsx
Comment thread packages/insomnia/src/ui/components/settings/llms/url-utils.ts
Comment thread packages/insomnia/src/main/ipc/main.ts Outdated
@Ali-Sab Ali-Sab force-pushed the feat/llm-url-options branch from 075a778 to 13d9ff4 Compare June 1, 2026 17:14
@Ali-Sab Ali-Sab force-pushed the feat/llm-url-options branch from 13d9ff4 to 479e8d1 Compare June 2, 2026 13:51
@Ali-Sab Ali-Sab merged commit efe930f into Kong:develop Jun 2, 2026
28 of 32 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants