Skip to content

Add import information skill - #2130

Merged
rohitkumarbhagat merged 34 commits into
datacommonsorg:masterfrom
rohitkumarbhagat:dc-import-info
Aug 5, 2026
Merged

Add import information skill#2130
rohitkumarbhagat merged 34 commits into
datacommonsorg:masterfrom
rohitkumarbhagat:dc-import-info

Conversation

@rohitkumarbhagat

@rohitkumarbhagat rohitkumarbhagat commented Aug 4, 2026

Copy link
Copy Markdown
Contributor

Summary

  • add the read-only dc-import-info skill for inspecting Data Commons extract-and-transform imports
  • provide bounded recipes for repository discovery, Scheduler configuration, Spanner status, GCS artifacts, Batch jobs, tasks, logs, and source provenance
  • add centralized environment configuration, dependency readiness checks, and Python helpers for import discovery and finalized summaries
  • register the skill and integrate its dependencies and tests with the repository test runner
  • keep loader investigation, root-cause diagnosis, remediation, and cloud mutations explicitly out of scope

Testing

  • .env/bin/python -m unittest discover -v -s agents/common -p "*_test.py"

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces a read-only agent support framework (dc-import-info skill) for inspecting Data Commons import extraction and transformation (ET) pipelines. It adds structured operational recipes (GCP Batch, GCS, Logging, Scheduler, Spanner, and local), architectural references, environment configuration defaults, and Python helper scripts with unit tests. Feedback on the changes suggests defensively stripping whitespace from absolute_import_name in the GCS summary-list helper to prevent validation failures, and adding a conditional check in the Scheduler describe-job recipe's jq command to robustly handle missing or null HTTP target bodies.

Comment thread agents/common/scripts/list_import_summaries.py Outdated
Comment thread agents/common/recipes/gcp/scheduler/describe-job.md Outdated
@rohitkumarbhagat rohitkumarbhagat changed the title Dc import info Dc import info skill Aug 4, 2026
rohitkumarbhagat and others added 28 commits August 4, 2026 17:07
…ources with a central configuration file and explicit prompt overrides
…documentation, and remove obsolete import utility scripts
…elate-import-runs implementation with list-import-summaries logic
…esolution with Batch trace, and update contract tests
@rohitkumarbhagat rohitkumarbhagat changed the title Dc import info skill Add import information skill Aug 5, 2026
@rohitkumarbhagat
rohitkumarbhagat marked this pull request as ready for review August 5, 2026 04:29
@rohitkumarbhagat
rohitkumarbhagat requested a review from ajaits August 5, 2026 04:29
@rohitkumarbhagat
rohitkumarbhagat merged commit 8515953 into datacommonsorg:master Aug 5, 2026
14 checks passed
@rohitkumarbhagat
rohitkumarbhagat deleted the dc-import-info branch August 5, 2026 16:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants