Skip to content

UAT US8/US7: ASR mishears the wake-name "Dotty", breaking name + state-trigger phrases #164

Description

@BrettKinny

Symptom. WhisperLocal ASR repeatedly transcribes the persona name "Dotty" as
something else. Observed this session: Jody, Jodi, Claudia, Donny, Dottie, Duddy.
Because state-trigger phrases and person-tools match on the literal name, the
mis-transcription silently breaks them.

Impact (highest of the session). Cascades into multiple failures:

  • US8 "goodnight Dotty" → heard "Good night, Duddy" → sleep trigger never matched, no state_changed → sleep.
  • US7 "wake up" (exit security) → sticky-state exit failed; had to force idle from the dashboard.

Expected. "Dotty" transcribes reliably; name-bearing triggers fire.

Actual / log excerpt.

20:05:46 识别文本: Good night, Duddy.        # US8 — no state_changed->sleep followed
20:07:03 识别文本: Dotty, can you take watch phone?
19:48:05 大模型收到用户消息: {"content": "Jody, what's the hardest question?"}
20:01:31 vision ... question=Donny, what do you see right now?

Suggested fixes to explore. ASR hotword/biasing for "Dotty"; fuzzy-match the
name in trigger-phrase detection; or a post-ASR alias map (Dottie/Donny/Duddy/… → Dotty).

Related: #105 (ambient ASR garbage), #135 (ASR runtime migration).


From the filmed UAT session 2026-07-11 (uat-sessions/2026-07-11/: results.csv, container logs, two video recordings). Investigated and drafted with AI assistance (Claude Fable 5 via Claude Code); human-reviewed before filing.

Activity

  1. added
    bugSomething isn't working
    area:xiaozhiUnraid xiaozhi-server container + custom providers
    needs-triageAwaiting triage (see docs/agents/triage-labels.md)
    ready-for-humanRequires human implementation or live-device verification
    status:activeReady to start, not blocked
    and removed
    needs-triageAwaiting triage (see docs/agents/triage-labels.md)
    on Jul 11, 2026
  2. BrettKinny commented on Jul 11, 2026

    @BrettKinny
    OwnerAuthor

    This was generated by AI during triage.

    Implemented in draft PR #171: the filmed high-confidence Duddy wake-name substitution now normalizes to Dotty, while common real names such as Donny/Jody/Jodi/Claudia remain untouched. Regression coverage includes sleep-phrase routing and word boundaries.

    The US7 wake up attempt was a separate low-confidence ASR miss (Welcome), not a name-alias or state-dispatch failure. A distinct reconnect-state gap discovered during analysis is tracked in #170.

    RC verification: replay good night, Dotty and bare wake up on device, confirming ASR text and state transitions. Evidence clip: 2026-07-11-US8-FAIL-phone.mp4.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:xiaozhiUnraid xiaozhi-server container + custom providersbugSomething isn't workingready-for-humanRequires human implementation or live-device verificationstatus:activeReady to start, not blocked

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions