Hey! I was going through the codebase and noticed pkg/llm/ is hardcoded to Anthropic right now. There's also an unused OpenAIAPIKey field in pkg/param/param.go (L55) — looks like alternative provider support was planned at some point?
|
|
|
AnthropicAPIKey string `yaml:"anthropic_api_key"` |
|
OpenAIAPIKey string `yaml:"openai_api_key"` |
|
|
I'd love to add Ollama support so the apko YAML generation works locally without needing a paid API key. This would make self-hosted deployments and local dev a lot easier.
Ollama exposes an OpenAI-compatible API at localhost:11434/v1 and supports tool use — so the approach would be extracting a provider interface from the current Anthropic code and adding an Ollama implementation alongside it. Anthropic stays the default, Ollama is opt-in via config.
Would you be open to this?
Hey! I was going through the codebase and noticed
pkg/llm/is hardcoded to Anthropic right now. There's also an unusedOpenAIAPIKeyfield inpkg/param/param.go(L55) — looks like alternative provider support was planned at some point?securebuild/pkg/param/param.go
Lines 53 to 56 in 635dd5b
I'd love to add Ollama support so the apko YAML generation works locally without needing a paid API key. This would make self-hosted deployments and local dev a lot easier.
Ollama exposes an OpenAI-compatible API at
localhost:11434/v1and supports tool use — so the approach would be extracting a provider interface from the current Anthropic code and adding an Ollama implementation alongside it. Anthropic stays the default, Ollama is opt-in via config.Would you be open to this?