feat: smart federation routing (load + VRAM + model + prefix affinity + cross-server sync) and unified Cluster UI#10124

Open

localai-bot wants to merge 18 commits into

feat/p2p-federation-clusterrouting

Commits on Jun 1, 2026

feat(p2p): gossip free VRAM per node and add testable online check
mudler
committed
feat(p2p): route federation with shared clusterrouting policy (load + VRAM)
mudler
committed
feat(routing): add load-guarded PickWithAffinity for prefix-cache routing
mudler
committed
feat(p2p): gossip each peer's model set for model-aware federation
mudler
committed
feat(p2p): model-filtered federation candidates and request model extraction
mudler
committed
feat(p2p): affinity-aware peer selection and federation body-limit flag
mudler
committed
feat(p2p): L7 HTTP-terminating federation proxy with model + prefix-affinity routing
mudler
committed
refactor(p2p): dedupe forwarded Connection header and drop unused extractModel param
mudler
committed
feat(p2p): edgevpn generic-channel publisher and handler for affinity sync
mudler
committed
feat(p2p): optional cross-server prefix-affinity sync over the generic channel
mudler
committed
feat(ui): add useP2PMode hook and embedded prop to Nodes and P2P pages
mudler
committed
feat(ui): add Cluster page composing distributed and swarm sections
mudler
committed
feat(ui): route /app/cluster, redirect /app/p2p and /app/nodes, single sidebar entry
mudler
committed
refactor(ui): repoint internal links from /app/nodes to /app/cluster
mudler
committed
test(ui): e2e specs for merged Cluster page and old-route redirects
mudler
committed
test(ui): repoint node-backend-actions spec to /app/cluster
mudler
committed

Commits on Jun 3, 2026