Issues

• Inferenceset scale down does not wait for running requests

  bug
  Bug

  kaito-project/kaito#2407 · Filter by author 2170chm opened on Oct 8, 2026
  

• refactor: decouple RAGEngine guardrail core from llm-guard for reuse

  kaito-project/kaito#2378 · Filter by author xiaoqi-7 opened on Oct 2, 2026

• RAGEngine silently ignores spec.embedding.remote and embeds with a local model instead

  kaito-project/kaito#2365 · Filter by author ishangupta-ds opened on Sep 20, 2026

• Migrate LMCache from in-process mode to multi-process mode

  enhancement
  kaito-project/kaito#2363 · Filter by author zhehli688 opened on Sep 18, 2026

• feat: evaluate streaming output guardrails with Envoy ext_proc

  enhancement
  kaito-project/kaito#2358 · Filter by author xiaoqi-7 opened on Sep 17, 2026

• feat: evaluate Istio Gateway output guardrails with Envoy ext_proc

  enhancement
  kaito-project/kaito#2343 · Filter by author xiaoqi-7 opened on Sep 15, 2026

• bug: CDI GPU discovery persistently fails on a subset of AKS A100 nodes

  kaito-project/kaito#2326 · Filter by author zhuangqh opened on Sep 7, 2026

• Inference cold start: measured breakdown and proposed optimizations

  enhancement
  kaito-project/kaito#2325 · Filter by author zhuangqh opened on Sep 7, 2026

• Enable expert parallelism by default for MoE models

  enhancement
  kaito-project/kaito#2305 · Filter by author zhehli688 opened on Aug 28, 2026

• bug: Static NodePool: infinite NodeClaim create/delete churn when capacity/quota is unsatisfiable

  bug
  kaito-project/kaito#2295 · Filter by author zhuangqh opened on Aug 24, 2026
  1

  

• feat: preset-driven speculative decoding toggle for Workspace inference

  kaito-project/kaito#2286 · Filter by author zhuangqh opened on Aug 21, 2026
  1

  

• nvme disk missing when creating node with karpenter

  bug
  kaito-project/kaito#2282 · Filter by author zhuangqh opened on Aug 20, 2026
  1

  

• Report actual max-model-len in Workspace status

  enhancementgood first issue
  kaito-project/kaito#2257 · Filter by author zhehli688 opened on Aug 5, 2026
  2

• Expose terminationGracePeriodSeconds in InferenceSetTemplate so users can set a grace period appropriate for their model and workload:

  enhancement
  kaito-project/kaito#2253 · Filter by author filidav opened on Aug 4, 2026

• Make Flux optional for GWIE chart deployment

  enhancement
  kaito-project/kaito#2252 · Filter by author henrichter-sap opened on Aug 4, 2026
  2

• support custom node taints beyond spot instances

  enhancement
  kaito-project/kaito#2220 · Filter by author filidav opened on Jul 24, 2026
  1

• Configurable OCI source and image registry for InferenceSet auto-provisioned InferencePool/GW extension

  enhancement
  kaito-project/kaito#2218 · Filter by author filidav opened on Jul 23, 2026
  1

• Improve drift-driven node image upgrade for Karpenter node provisioner

  kaito-project/kaito#2196 · Filter by author rambohe-ch opened on Jul 17, 2026
  

• get_max_gpu_memory_utilization() conflicts with a hardcoded --gpu-memory-utilization=0.84

  bug
  kaito-project/kaito#2191 · Filter by author zhehli688 opened on Jul 16, 2026
  2

• BYO mode: InferenceSet multi-node workspaces can deadlock when competing for the same nodepool

  enhancement
  kaito-project/kaito#2174 · Filter by author zhuangqh opened on Jul 2, 2026
  2

• Changes to workspace in KAITO are not applied StatefulSet

  enhancement
  kaito-project/kaito#2124 · Filter by author oreakinodidi98 opened on Jun 18, 2026
  2

• Azure GPU SKU mapping mismatch and vLLM runtime failure on Standard_NC6s_v3 / Standard_NC4as_T4_v3

  kaito-project/kaito#2114 · Filter by author avi1512 opened on Jun 17, 2026
  6

• Track HuggingFace download speed of the largest model across Azure regions

  kaito-project/kaito#2080 · Filter by author rambohe-ch opened on Jun 2, 2026

• Expose model download progress metrics and surface remaining download time in Workspace / InferenceSet status

  kaito-project/kaito#2074 · Filter by author rambohe-ch opened on May 28, 2026
  1

  

• [Regression] Tracking issues found in distributed inference / LMCache integration

  bug
  kaito-project/kaito#2012 · Filter by author zhuangqh opened on Apr 30, 2026
  1