Skip to content

Local Ollama as additional embedding option #19

Open

Description

@savioruz

Local Ollama as additional embedding option

Context

Competitor uteke leads because it is 100% offline. Memayu needs to close the gap by offering more local embedding options.

Task

In addition to the Candle-embedded backend (Issue 1), add an EmbedderProvider option that points to a local Ollama instance (not Ollama Cloud) already running on the user's own machine/VPS (http://localhost:11434). This is far cheaper to implement than Issue 1 (it reuses the existing HTTP client pattern for remote providers — only the default base_url changes to localhost) and fits users who already run Ollama for other purposes.

Requirements

  • Reuse the existing HttpLlmProvider/EmbedderProvider pattern in memayu-llm-client; just add a preset config provider = "ollama_local" with default base_url = http://localhost:11434
  • Auto-detect dimension still applies, same as other providers

Acceptance criteria

  • A user with local Ollama running (any embedding model, e.g. nomic-embed-text) can use it immediately without manually configuring base_url when on the standard port

Activity

  1. added
    priority-mediumMedium priority — important but not blocking
    featureNew feature or capability
    self-hostedRelates to self-hosted / local-first usage
    on Aug 13, 2026
  2. changed the title [-]Local Ollama sebagai opsi embedding tambahan[/-] [+]Local Ollama as additional embedding option[/+] on Aug 13, 2026
  3. savioruz commented on Aug 16, 2026

    @savioruz
    OwnerAuthor

    Related: PR #58 (local Candle embedder + CLI wizard + headless fallback). The Candle local embedding also ships via PR #57; #58 is a superset on the same base — see review thread for merge-order recommendation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    featureNew feature or capabilitypriority-mediumMedium priority — important but not blockingself-hostedRelates to self-hosted / local-first usage

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions