Skip to content

Feature/empty local fallback soft task type - #12

Merged
haoruilee merged 2 commits into
mainfrom
feature/empty-local-fallback-soft-task-type
Apr 10, 2026
Merged

haoruilee merged 2 commits into
mainfrom
feature/empty-local-fallback-soft-task-type

Conversation

@Sandyuelin

Copy link
Copy Markdown

feat(router): empty local fallback + soft task_type scores

  • Retry cloud when local returns no assistant text, no tool_calls, and
    completion_tokens is 0 (non-streaming), or when streaming yields no
    substantive deltas before [DONE] (when fallbackToCloud is on).
  • Add WorkflowTaskTypeScorer: research +8, memory +6, tool +12 from
    task_type or metadata.task_type without forcing cloud.
  • Tests for empty-response detection and routing hints.

侯悦琳 added 2 commits April 7, 2026 10:58
- Retry cloud when local returns no assistant text, no tool_calls, and
  completion_tokens is 0 (non-streaming), or when streaming yields no
  substantive deltas before [DONE] (when fallbackToCloud is on).
- Add WorkflowTaskTypeScorer: research +8, memory +6, tool +12 from
  task_type or metadata.task_type without forcing cloud.
- Tests for empty-response detection and routing hints.

Made-with: Cursor
- Version 0.0.0-empty-local-fallback.1 (branch try, not npm release)
- Fallback: empty/invalid local response → cloud without local retry
- Plugin marked experimental for feature/empty-local-fallback-soft-task-type
@haoruilee
haoruilee merged commit 8440e2d into main Apr 10, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants