Skip to content

feat: delayed ground truth tutorial (POC) - #72

Draft
tomtranjr wants to merge 1 commit into
mainfrom
feature/65-delayed-ground-truth-tutorial
Draft

feat: delayed ground truth tutorial (POC)#72
tomtranjr wants to merge 1 commit into
mainfrom
feature/65-delayed-ground-truth-tutorial

Conversation

@tomtranjr

Copy link
Copy Markdown
Member

summary

  • POC for New input and delayed ground truth simulation #65: simulate incoming data with delayed ground truth
  • trains on first 40% of housing dataset, streams remaining 60% in 5 batches, ground truth written 30s after each batch is scored
  • new folder example/tutorial_streaming/, reuses existing train/register/drift/grafana scripts unchanged

test plan

  • unit tests pass (pytest)
  • manual run against a deployed stack

follow-up (not in this PR)

  • replace wall-clock sleep with backdated timestamps
  • promote to a deployml tutorial CLI command with dataset upload support

related

Closes #65. POC that trains on a 40% data cutoff, then streams the
rest in batches with ground truth arriving after a delay.

Claude-Session: https://claude.ai/code/session_01EDnyr4JaiZWq56E2AVioAr
@coderabbitai

coderabbitai Bot commented Aug 25, 2026

Copy link
Copy Markdown

Important

Draft PR not reviewed

Draft PRs are not automatically reviewed by default.

  • Trigger a manual review

To automatically review draft PRs, update your CodeRabbit configuration:

reviews:
  auto_review:
    drafts: true

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@tomtranjr tomtranjr self-assigned this Aug 25, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

New input and delayed ground truth simulation

1 participant