Skip to content

[chore] Move agent skills from agents/ to canonical .agents/ - #5603

Merged
mmabrouk merged 1 commit into
mainfrom
refactor/moving-everything-from-agents-.agents-dir
Jul 31, 2026
Merged

[chore] Move agent skills from agents/ to canonical .agents/#5603
mmabrouk merged 1 commit into
mainfrom
refactor/moving-everything-from-agents-.agents-dir

Conversation

@ashrafchowdury

Copy link
Copy Markdown
Contributor

Context

The repo kept agent skills in two places. Nineteen skills lived in the canonical .agents/skills/ (read natively by Codex, symlinked into .claude/skills/ for Claude). Five more (scan-codebase, test-codebase, sync-findings, triage-findings, resolve-findings) plus their shared references and the code-review / diataxis docs lived in a separate no-dot agents/ directory.

That no-dot path matches no tool's discovery location, so those five skills were invisible to Claude, Codex, and Cursor. This moves them to the canonical .agents/ location so every tool picks them up, following the single-source-of-truth-plus-symlinks convention the repo already uses.

Changes

Relocated the whole tree with git mv (history preserved; git detects these as pure renames):

agents/skills/*  ->  .agents/skills/*   (5 skills + shared/ + README)
agents/docs/*    ->  .agents/docs/*     (code-review/ + diataxis/)

Then wired discovery and fixed references:

  • Added .claude/skills/{scan-codebase,triage-findings,resolve-findings,sync-findings,test-codebase} symlinks into .agents/skills/, matching the existing 19. Codex reads .agents/ directly; Claude reads the symlinks.
  • Added the five !.claude/skills/<name> negations to .gitignore so the symlinks are tracked (the dir uses an allowlist).
  • Updated the four live references to the old path: AGENTS.md (diataxis digest), the moved README.md, and two docs/**/findings.md links.
  • Deleted the now-empty agents/ directory.

Tests / notes

  • All five .claude/skills symlinks resolve to a real SKILL.md; the ../shared/references/… links inside each skill still resolve (shared/ moved with them).
  • Confirmed no CI workflow, build script, or package.json referenced the old path.
  • Left untouched on purpose: services/runner/** and web/oss/src/components/Drives/driveTree.ts mention agents/skills/<digest> and agents/sessions/…, and the SDK has sdks/python/agenta/sdk/agents/skills/. These are the runner's in-sandbox runtime namespace and SDK source, unrelated to the repo directory that moved (coincidental name).
  • Behavior change (intended): the five findings skills are now discoverable by Claude and Codex where they were invisible before. Names are unique, so no picker collisions.
  • Not updated: docs/design/agents-md-compartmentalization/{findings,playbook}.md still describe these skills as "invisible to every tool." That is now stale, but those files are a dated design record, so they are left as the snapshot they were.

🤖 Generated with Claude Code

- Introduced five core skills for findings-driven review: scan-codebase, test-codebase, sync-findings, triage-findings, and resolve-findings.
- Created detailed documentation for each skill, outlining their roles, parameters, workflows, and rules.
- Established a shared findings lifecycle and schema to standardize findings management across skills.
- Implemented YAML configurations for OpenAI integration for each skill.
- Updated .gitignore to include new skill directories and adjusted references in AGENTS.md and findings documentation.
@dosubot dosubot Bot added the size:XS This PR changes 0-9 lines, ignoring generated files. label Jul 31, 2026
@vercel

vercel Bot commented Jul 31, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
agenta-documentation Ready Ready Preview Jul 31, 2026 6:37am

Request Review

@dosubot dosubot Bot added the refactoring A code change that neither fixes a bug nor adds a feature label Jul 31, 2026
@ashrafchowdury

Copy link
Copy Markdown
Contributor Author

Trying to clean things up, having 3 sources of agent skills makes me confused

@coderabbitai

coderabbitai Bot commented Jul 31, 2026

Copy link
Copy Markdown

Review Change Stack

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro Plus

Run ID: 6c6716ab-27d6-4ee3-ad84-58054530531f

📥 Commits

Reviewing files that changed from the base of the PR and between 53aaf6f and fe6d4c4.

📒 Files selected for processing (50)
  • .agents/docs/code-review/README.md
  • .agents/docs/code-review/criteria.md
  • .agents/docs/code-review/deliverables.md
  • .agents/docs/code-review/docs.specs.md
  • .agents/docs/code-review/guidelines.md
  • .agents/docs/code-review/instructions.md
  • .agents/docs/code-review/rubrics/api.md
  • .agents/docs/code-review/rubrics/architecture.md
  • .agents/docs/code-review/rubrics/databases.md
  • .agents/docs/code-review/rubrics/general.md
  • .agents/docs/code-review/rubrics/observability.md
  • .agents/docs/code-review/rubrics/performance.md
  • .agents/docs/code-review/rubrics/qa.md
  • .agents/docs/code-review/rubrics/sdk.md
  • .agents/docs/code-review/rubrics/security.md
  • .agents/docs/code-review/rubrics/services.md
  • .agents/docs/code-review/rubrics/testability.md
  • .agents/docs/code-review/rubrics/web.md
  • .agents/docs/code-review/templates/findings.md
  • .agents/docs/code-review/templates/metadata.json
  • .agents/docs/code-review/templates/plan.md
  • .agents/docs/code-review/templates/progress.md
  • .agents/docs/code-review/templates/questions.md
  • .agents/docs/code-review/templates/risks.md
  • .agents/docs/code-review/templates/scope.md
  • .agents/docs/code-review/templates/scorecard.md
  • .agents/docs/code-review/templates/summary.md
  • .agents/docs/diataxis/initial.digest.md
  • .agents/skills/README.md
  • .agents/skills/resolve-findings/SKILL.md
  • .agents/skills/resolve-findings/agents/openai.yaml
  • .agents/skills/scan-codebase/SKILL.md
  • .agents/skills/scan-codebase/agents/openai.yaml
  • .agents/skills/shared/references/findings.lifecycle.md
  • .agents/skills/shared/references/findings.schema.md
  • .agents/skills/sync-findings/SKILL.md
  • .agents/skills/sync-findings/agents/openai.yaml
  • .agents/skills/test-codebase/SKILL.md
  • .agents/skills/test-codebase/agents/openai.yaml
  • .agents/skills/triage-findings/SKILL.md
  • .agents/skills/triage-findings/agents/openai.yaml
  • .claude/skills/resolve-findings
  • .claude/skills/scan-codebase
  • .claude/skills/sync-findings
  • .claude/skills/test-codebase
  • .claude/skills/triage-findings
  • .gitignore
  • AGENTS.md
  • docs/design/prompt-runtime-unification/findings.md
  • docs/designs/support-fields/findings.md

📝 Walkthrough

Summary by CodeRabbit

  • Documentation
    • Added comprehensive code-review workflows, criteria, rubrics, templates, and lifecycle guidance.
    • Added documentation guidance based on the Diátaxis framework.
  • New Features
    • Added skills for scanning, testing, triaging, synchronizing, and resolving code-review findings.
    • Added shared findings schemas and lifecycle references.
    • Added agent configurations and corresponding Claude skill integrations.
  • Chores
    • Standardized skill and documentation paths and updated related references and ignore rules.

Walkthrough

Added a structured code-review documentation framework with domain rubrics, reusable templates, findings lifecycle guidance, five agent skills, OpenAI metadata, Claude symlinks, and canonical .agents path updates.

Changes

Code-review documentation

Layer / File(s) Summary
Review documentation and templates
.agents/docs/code-review/*, .agents/docs/diataxis/initial.digest.md
Added artifact structure, lifecycle rules, criteria, deliverables, review instructions, templates, and Diátaxis guidance.
Domain review rubrics
.agents/docs/code-review/rubrics/*
Added specialized rubrics for API, architecture, databases, general quality, observability, performance, SDKs, security, services, testability, and web reviews. The QA rubric now redirects to specialized rubrics.

Findings workflow

Layer / File(s) Summary
Findings schema and workflows
.agents/skills/shared/references/*, .agents/skills/{scan-codebase,test-codebase,sync-findings,triage-findings,resolve-findings}/SKILL.md
Added canonical finding fields, lifecycle statuses, scan/test/sync/triage/resolve procedures, defaults, validation rules, and ambiguity handling.

Agent integration

Layer / File(s) Summary
Agent interfaces and path wiring
.agents/skills/*/agents/openai.yaml, .claude/skills/*, .gitignore, AGENTS.md, docs/design*/findings.md, .agents/skills/README.md
Added agent metadata and Claude symlinks. Updated ignore rules and references to canonical .agents paths.

Estimated code review effort: 3 (Moderate) | ~30 minutes

Possibly related PRs

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly summarizes the primary change: moving agent skills from agents/ to the canonical .agents/ directory.
Description check ✅ Passed The description accurately explains the relocation, symlink updates, reference fixes, discovery behavior, and intentional exclusions.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch refactor/moving-everything-from-agents-.agents-dir

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 17

Note

Due to the large number of review comments, Critical, Major severity comments were prioritized as inline comments.

🟡 Minor comments (9)
.agents/docs/code-review/criteria.md-13-22 (1)

13-22: 📐 Maintainability & Code Quality | 🟡 Minor | ⚡ Quick win

Add language tags to both diagram fences.

The same unlabeled-fence issue appears in both documents.

  • .agents/docs/code-review/criteria.md#L13-L22: add text to the opening fence.
  • .agents/docs/code-review/guidelines.md#L137-L144: add text to the opening fence.

Source: Linters/SAST tools

.agents/docs/code-review/templates/findings.md-11-11 (1)

11-11: 📐 Maintainability & Code Quality | 🟡 Minor | ⚡ Quick win

Fix the evidence links in the template.

findings.md and evidence/ are sibling per-run artifacts. ../evidence/SLUG.md points outside the run directory. Use evidence/SLUG.md in both examples.

Proposed link fix
- [evidence](../evidence/SLUG.md)
+ [evidence](evidence/SLUG.md)
...
-**Evidence:** [evidence/SLUG.md](../evidence/SLUG.md)
+**Evidence:** [evidence/SLUG.md](evidence/SLUG.md)

Also applies to: 32-32

.agents/docs/code-review/templates/progress.md-15-28 (1)

15-28: 🗄️ Data Integrity & Integration | 🟡 Minor | ⚡ Quick win

Represent conditional tasks explicitly.

risks.md, questions.md, and scorecard.md are conditional outputs, but the task log always includes their creation tasks and has no not applicable state. Add n/a or make these rows conditional. A completed progress log must distinguish “not required” from “not done”.

.agents/docs/code-review/templates/questions.md-3-3 (1)

3-3: 🗄️ Data Integrity & Integration | 🟡 Minor | ⚡ Quick win

Reference the canonical notes section.

The template directs internal questions to notes/, but the findings schema defines ## Notes inside findings.md and does not define a notes/ artifact. Change this instruction to reference the canonical ## Notes section or define notes/ in the artifact contract.

.agents/docs/diataxis/initial.digest.md-3-3 (1)

3-3: 📐 Maintainability & Code Quality | 🟡 Minor | ⚡ Quick win

Remove internal citation metadata from link labels.

Normal Markdown rendering exposes text such as oai_citation:0‡diataxis.fr to readers. Replace these labels with descriptive text such as Diátaxis, or confirm that a publication step removes the metadata before release. Apply the same fix to the repeated citations in this file.

.agents/docs/code-review/rubrics/api.md-35-35 (1)

35-35: 🎯 Functional Correctness | 🟡 Minor | ⚡ Quick win

Define enum compatibility by serialized values.

Reordering named enum values does not change wire behavior when clients serialize names. Renumbering numeric enum values can break clients. Change this criterion to distinguish enum-name removal from numeric-value changes.

.agents/docs/code-review/rubrics/qa.md-5-6 (1)

5-6: 🎯 Functional Correctness | 🟡 Minor | ⚡ Quick win

Correct the criterion number for testability.md.

The notice maps both specialist rubrics to criterion 10. testability.md uses criterion 9, while observability.md uses criterion 10. Change the testability entry to criterion 9.

.agents/skills/scan-codebase/SKILL.md-22-31 (1)

22-31: 🎯 Functional Correctness | 🟡 Minor | ⚡ Quick win

Define the behavior of depth=shallow.

depth accepts shallow and deep, but the workflow does not apply a different inspection scope. Line 66 also says to bias toward deep inspection. A shallow request can therefore run the same deep review.

Define the files and checks for each value. Require the selected depth during scope confirmation.

Also applies to: 64-68

.agents/skills/test-codebase/SKILL.md-21-30 (1)

21-30: 🎯 Functional Correctness | 🟡 Minor | ⚡ Quick win

Define the behavior for each depth value.

The interface accepts shallow and deep, but the workflow only confirms the value. It does not state which tests, repros, documentation checks, or full-suite work each value permits. Different invocations can therefore perform inconsistent validation.

Specify the required validation scope for both values, or remove the parameter.

Also applies to: 43-58


ℹ️ Review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro Plus

Run ID: 6c6716ab-27d6-4ee3-ad84-58054530531f

📥 Commits

Reviewing files that changed from the base of the PR and between 53aaf6f and fe6d4c4.

📒 Files selected for processing (50)
  • .agents/docs/code-review/README.md
  • .agents/docs/code-review/criteria.md
  • .agents/docs/code-review/deliverables.md
  • .agents/docs/code-review/docs.specs.md
  • .agents/docs/code-review/guidelines.md
  • .agents/docs/code-review/instructions.md
  • .agents/docs/code-review/rubrics/api.md
  • .agents/docs/code-review/rubrics/architecture.md
  • .agents/docs/code-review/rubrics/databases.md
  • .agents/docs/code-review/rubrics/general.md
  • .agents/docs/code-review/rubrics/observability.md
  • .agents/docs/code-review/rubrics/performance.md
  • .agents/docs/code-review/rubrics/qa.md
  • .agents/docs/code-review/rubrics/sdk.md
  • .agents/docs/code-review/rubrics/security.md
  • .agents/docs/code-review/rubrics/services.md
  • .agents/docs/code-review/rubrics/testability.md
  • .agents/docs/code-review/rubrics/web.md
  • .agents/docs/code-review/templates/findings.md
  • .agents/docs/code-review/templates/metadata.json
  • .agents/docs/code-review/templates/plan.md
  • .agents/docs/code-review/templates/progress.md
  • .agents/docs/code-review/templates/questions.md
  • .agents/docs/code-review/templates/risks.md
  • .agents/docs/code-review/templates/scope.md
  • .agents/docs/code-review/templates/scorecard.md
  • .agents/docs/code-review/templates/summary.md
  • .agents/docs/diataxis/initial.digest.md
  • .agents/skills/README.md
  • .agents/skills/resolve-findings/SKILL.md
  • .agents/skills/resolve-findings/agents/openai.yaml
  • .agents/skills/scan-codebase/SKILL.md
  • .agents/skills/scan-codebase/agents/openai.yaml
  • .agents/skills/shared/references/findings.lifecycle.md
  • .agents/skills/shared/references/findings.schema.md
  • .agents/skills/sync-findings/SKILL.md
  • .agents/skills/sync-findings/agents/openai.yaml
  • .agents/skills/test-codebase/SKILL.md
  • .agents/skills/test-codebase/agents/openai.yaml
  • .agents/skills/triage-findings/SKILL.md
  • .agents/skills/triage-findings/agents/openai.yaml
  • .claude/skills/resolve-findings
  • .claude/skills/scan-codebase
  • .claude/skills/sync-findings
  • .claude/skills/test-codebase
  • .claude/skills/triage-findings
  • .gitignore
  • AGENTS.md
  • docs/design/prompt-runtime-unification/findings.md
  • docs/designs/support-fields/findings.md

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Caution

Inline review comments failed to post. This is likely due to GitHub's internal server error or limits when posting large numbers of comments. If you are seeing this consistently it is likely a permissions issue. Please check "Moderation" -> "Code review limits" under your organization settings.

Actionable comments posted: 17

Note

Due to the large number of review comments, Critical, Major severity comments were prioritized as inline comments.

🟡 Minor comments (9)
.agents/docs/code-review/criteria.md-13-22 (1)

13-22: 📐 Maintainability & Code Quality | 🟡 Minor | ⚡ Quick win

Add language tags to both diagram fences.

The same unlabeled-fence issue appears in both documents.

  • .agents/docs/code-review/criteria.md#L13-L22: add text to the opening fence.
  • .agents/docs/code-review/guidelines.md#L137-L144: add text to the opening fence.

Source: Linters/SAST tools

.agents/docs/code-review/templates/findings.md-11-11 (1)

11-11: 📐 Maintainability & Code Quality | 🟡 Minor | ⚡ Quick win

Fix the evidence links in the template.

findings.md and evidence/ are sibling per-run artifacts. ../evidence/SLUG.md points outside the run directory. Use evidence/SLUG.md in both examples.

Proposed link fix
- [evidence](../evidence/SLUG.md)
+ [evidence](evidence/SLUG.md)
...
-**Evidence:** [evidence/SLUG.md](../evidence/SLUG.md)
+**Evidence:** [evidence/SLUG.md](evidence/SLUG.md)

Also applies to: 32-32

.agents/docs/code-review/templates/progress.md-15-28 (1)

15-28: 🗄️ Data Integrity & Integration | 🟡 Minor | ⚡ Quick win

Represent conditional tasks explicitly.

risks.md, questions.md, and scorecard.md are conditional outputs, but the task log always includes their creation tasks and has no not applicable state. Add n/a or make these rows conditional. A completed progress log must distinguish “not required” from “not done”.

.agents/docs/code-review/templates/questions.md-3-3 (1)

3-3: 🗄️ Data Integrity & Integration | 🟡 Minor | ⚡ Quick win

Reference the canonical notes section.

The template directs internal questions to notes/, but the findings schema defines ## Notes inside findings.md and does not define a notes/ artifact. Change this instruction to reference the canonical ## Notes section or define notes/ in the artifact contract.

.agents/docs/diataxis/initial.digest.md-3-3 (1)

3-3: 📐 Maintainability & Code Quality | 🟡 Minor | ⚡ Quick win

Remove internal citation metadata from link labels.

Normal Markdown rendering exposes text such as oai_citation:0‡diataxis.fr to readers. Replace these labels with descriptive text such as Diátaxis, or confirm that a publication step removes the metadata before release. Apply the same fix to the repeated citations in this file.

.agents/docs/code-review/rubrics/api.md-35-35 (1)

35-35: 🎯 Functional Correctness | 🟡 Minor | ⚡ Quick win

Define enum compatibility by serialized values.

Reordering named enum values does not change wire behavior when clients serialize names. Renumbering numeric enum values can break clients. Change this criterion to distinguish enum-name removal from numeric-value changes.

.agents/docs/code-review/rubrics/qa.md-5-6 (1)

5-6: 🎯 Functional Correctness | 🟡 Minor | ⚡ Quick win

Correct the criterion number for testability.md.

The notice maps both specialist rubrics to criterion 10. testability.md uses criterion 9, while observability.md uses criterion 10. Change the testability entry to criterion 9.

.agents/skills/scan-codebase/SKILL.md-22-31 (1)

22-31: 🎯 Functional Correctness | 🟡 Minor | ⚡ Quick win

Define the behavior of depth=shallow.

depth accepts shallow and deep, but the workflow does not apply a different inspection scope. Line 66 also says to bias toward deep inspection. A shallow request can therefore run the same deep review.

Define the files and checks for each value. Require the selected depth during scope confirmation.

Also applies to: 64-68

.agents/skills/test-codebase/SKILL.md-21-30 (1)

21-30: 🎯 Functional Correctness | 🟡 Minor | ⚡ Quick win

Define the behavior for each depth value.

The interface accepts shallow and deep, but the workflow only confirms the value. It does not state which tests, repros, documentation checks, or full-suite work each value permits. Different invocations can therefore perform inconsistent validation.

Specify the required validation scope for both values, or remove the parameter.

Also applies to: 43-58


ℹ️ Review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro Plus

Run ID: 6c6716ab-27d6-4ee3-ad84-58054530531f

📥 Commits

Reviewing files that changed from the base of the PR and between 53aaf6f and fe6d4c4.

📒 Files selected for processing (50)
  • .agents/docs/code-review/README.md
  • .agents/docs/code-review/criteria.md
  • .agents/docs/code-review/deliverables.md
  • .agents/docs/code-review/docs.specs.md
  • .agents/docs/code-review/guidelines.md
  • .agents/docs/code-review/instructions.md
  • .agents/docs/code-review/rubrics/api.md
  • .agents/docs/code-review/rubrics/architecture.md
  • .agents/docs/code-review/rubrics/databases.md
  • .agents/docs/code-review/rubrics/general.md
  • .agents/docs/code-review/rubrics/observability.md
  • .agents/docs/code-review/rubrics/performance.md
  • .agents/docs/code-review/rubrics/qa.md
  • .agents/docs/code-review/rubrics/sdk.md
  • .agents/docs/code-review/rubrics/security.md
  • .agents/docs/code-review/rubrics/services.md
  • .agents/docs/code-review/rubrics/testability.md
  • .agents/docs/code-review/rubrics/web.md
  • .agents/docs/code-review/templates/findings.md
  • .agents/docs/code-review/templates/metadata.json
  • .agents/docs/code-review/templates/plan.md
  • .agents/docs/code-review/templates/progress.md
  • .agents/docs/code-review/templates/questions.md
  • .agents/docs/code-review/templates/risks.md
  • .agents/docs/code-review/templates/scope.md
  • .agents/docs/code-review/templates/scorecard.md
  • .agents/docs/code-review/templates/summary.md
  • .agents/docs/diataxis/initial.digest.md
  • .agents/skills/README.md
  • .agents/skills/resolve-findings/SKILL.md
  • .agents/skills/resolve-findings/agents/openai.yaml
  • .agents/skills/scan-codebase/SKILL.md
  • .agents/skills/scan-codebase/agents/openai.yaml
  • .agents/skills/shared/references/findings.lifecycle.md
  • .agents/skills/shared/references/findings.schema.md
  • .agents/skills/sync-findings/SKILL.md
  • .agents/skills/sync-findings/agents/openai.yaml
  • .agents/skills/test-codebase/SKILL.md
  • .agents/skills/test-codebase/agents/openai.yaml
  • .agents/skills/triage-findings/SKILL.md
  • .agents/skills/triage-findings/agents/openai.yaml
  • .claude/skills/resolve-findings
  • .claude/skills/scan-codebase
  • .claude/skills/sync-findings
  • .claude/skills/test-codebase
  • .claude/skills/triage-findings
  • .gitignore
  • AGENTS.md
  • docs/design/prompt-runtime-unification/findings.md
  • docs/designs/support-fields/findings.md
🛑 Comments failed to post (17)
.agents/docs/code-review/deliverables.md (2)

7-30: 🗄️ Data Integrity & Integration | 🟠 Major | ⚡ Quick win

Align artifact requiredness across the framework.

The closure gate and artifact maps define different requiredness rules. Choose one policy and apply it to every artifact.

  • .agents/docs/code-review/deliverables.md#L7-L30: define the canonical requiredness for plan, progress, findings, summary, metadata, and evidence.
  • .agents/docs/code-review/README.md#L80-L87: align the progress.md rule.
  • .agents/docs/code-review/README.md#L102-L109: align the evidence exception.
  • .agents/docs/code-review/README.md#L111-L118: align the metadata.json rule.
  • .agents/docs/code-review/README.md#L124-L131: align the findings.md rule.
  • .agents/docs/code-review/README.md#L155-L162: align the summary.md rule.
  • .agents/docs/code-review/README.md#L188-L207: update the quick-reference table and evidence footnote.
  • .agents/docs/code-review/guidelines.md#L45-L83: update the artifact map to use the same policy.
📍 Affects 3 files
  • .agents/docs/code-review/deliverables.md#L7-L30 (this comment)
  • .agents/docs/code-review/README.md#L80-L87
  • .agents/docs/code-review/README.md#L102-L109
  • .agents/docs/code-review/README.md#L111-L118
  • .agents/docs/code-review/README.md#L124-L131
  • .agents/docs/code-review/README.md#L155-L162
  • .agents/docs/code-review/README.md#L188-L207
  • .agents/docs/code-review/guidelines.md#L45-L83

34-44: 🗄️ Data Integrity & Integration | 🟠 Major | ⚡ Quick win

Use one severity vocabulary for findings.

The deliverables and templates support info, but the procedure rejects it. This can produce findings and metadata that do not satisfy the documented procedure.

  • .agents/docs/code-review/deliverables.md#L34-L44: decide whether info belongs in confirmed findings.
  • .agents/docs/code-review/instructions.md#L65-L78: update the allowed severity set.
  • .agents/docs/code-review/templates/findings.md#L3-L5: update the template guidance.
  • .agents/docs/code-review/templates/metadata.json#L13-L18: update finding_counts.
📍 Affects 4 files
  • .agents/docs/code-review/deliverables.md#L34-L44 (this comment)
  • .agents/docs/code-review/instructions.md#L65-L78
  • .agents/docs/code-review/templates/findings.md#L3-L5
  • .agents/docs/code-review/templates/metadata.json#L13-L18
.agents/docs/code-review/guidelines.md (1)

103-131: 🗄️ Data Integrity & Integration | 🟠 Major | ⚡ Quick win

Add the QA rubric to every rubric index.

The review stack lists .agents/docs/code-review/rubrics/qa.md, but the canonical rubric indexes omit it.

  • .agents/docs/code-review/guidelines.md#L103-L131: add qa.md to the domain rubric table.
  • .agents/docs/code-review/deliverables.md#L112-L129: add qa.md to the rubric references.
  • .agents/docs/code-review/criteria.md#L166-L183: add a QA column and define its criterion coverage.
📍 Affects 3 files
  • .agents/docs/code-review/guidelines.md#L103-L131 (this comment)
  • .agents/docs/code-review/deliverables.md#L112-L129
  • .agents/docs/code-review/criteria.md#L166-L183
.agents/docs/code-review/instructions.md (1)

9-14: 🗄️ Data Integrity & Integration | 🟠 Major | ⚡ Quick win

Wire the universal criteria into review startup.

The framework requires criteria.md, but the harness indexes and startup sequence omit it.

  • .agents/docs/code-review/instructions.md#L9-L14: add criteria.md as a pre-review read.
  • .agents/docs/code-review/README.md#L5-L25: list criteria.md with the fixed harness files.
  • .agents/docs/code-review/README.md#L173-L205: include criteria.md in the lifecycle and quick-reference table.
📍 Affects 2 files
  • .agents/docs/code-review/instructions.md#L9-L14 (this comment)
  • .agents/docs/code-review/README.md#L5-L25
  • .agents/docs/code-review/README.md#L173-L205
.agents/docs/code-review/rubrics/api.md (1)

3-5: 🎯 Functional Correctness | 🟠 Major | ⚡ Quick win

Scope HTTP criteria to HTTP APIs.

This rubric applies to GraphQL, gRPC, WebSocket, and async message APIs, but it requires REST/HTTP concepts such as resource nouns, HTTP verbs, HTTP status codes, URL or Accept versioning, and rate-limit headers. Add protocol applicability to each criterion or split the HTTP criteria into a separate rubric. Make rate-limit headers conditional on an HTTP rate-limit contract.

Also applies to: 22-25, 42-44, 50-61

.agents/docs/code-review/rubrics/databases.md (2)

28-28: 🚀 Performance & Scalability | 🟠 Major | ⚡ Quick win

Do not order composite indexes by selectivity alone.

Index order depends on equality and range predicates, joins, sort requirements, and the query plan. Selectivity alone can produce an ineffective index. Require query-pattern-driven ordering and plan validation instead.


36-36: 🩺 Stability & Availability | 🟠 Major | ⚡ Quick win

🧩 Analysis chain

🏁 Script executed:

#!/bin/bash
set -euo pipefail

rg -n -i --glob '!node_modules/**' --glob '!dist/**' \
  '(postgres|mysql|mariadb|sqlite|sql server|cockroach|alembic|flyway|liquibase|django migrations)' .

Repository: Agenta-AI/agenta

Length of output: 50373


🏁 Script executed:

#!/bin/bash
set -euo pipefail

echo "== target file =="
wc -l .agents/docs/code-review/rubrics/databases.md
sed -n '1,80p' .agents/docs/code-review/rubrics/databases.md

echo
echo "== nearby migration-related rubric context =="
rg -n -i "migration|ALTER TABLE|ADD COLUMN|expand|contract|online|noop|fill|backfill|add_column|add value" .agents/docs/code-review/rubrics .agents/docs/code-review \
  || true

echo
echo "== broader database migration guidance =="
fd -i 'migration|database|databases|sql|docs|guide|rubric' .agents/docs/code-review -t f -x sh -c 'echo "--- $1"; sed -n "1,120p" "$1"' sh {}

Repository: Agenta-AI/agenta

Length of output: 42467


🏁 Script executed:

#!/bin/bash
set -euo pipefail

echo "== target file =="
wc -l .agents/docs/code-review/rubrics/databases.md
sed -s '1,80p' .agents/docs/code-review/rubrics/databases.md

echo
echo "== nearby migration-related rubric context =="
rg -n -i "migration|ALTER TABLE|ADD COLUMN|expand|contract|online|noop|fill|backfill|add_column|add value" .agents/docs/code-review/rubrics .agents/docs/code-review \
  || true

echo
echo "== broader database migration guidance =="
fd -i 'migration|database|databases|sql|docs|guide|rubric' .agents/docs/code-review -t f -x sh -c 'echo "--- $1"; sed -n "1,160p" "$1"' sh {}

Repository: Agenta-AI/agenta

Length of output: 50372


Make the ADD COLUMN criterion database-specific.

DEFAULT semantics still matter by engine and version: newer PostgreSQL allows metadata-only NOT NULL defaults, while older PostgreSQL and many other engines can rewrite or lock large tables. Name the supported databases/versions, or require documented expand/contract or online migration guidance for the target engine.

.agents/docs/code-review/rubrics/observability.md (1)

26-30: 🔒 Security & Privacy | 🟠 Major | ⚡ Quick win

Prevent PII leakage through required log context.

O-1 requires a user ID in error logs, while O-5 prohibits sensitive data in logs. A raw user ID can be PII. Require request IDs, trace IDs, or approved pseudonymous subject identifiers instead. Explicitly prohibit raw emails and user identifiers unless policy permits them.

.agents/docs/code-review/rubrics/services.md (3)

26-30: 🩺 Stability & Availability | 🟠 Major | ⚡ Quick win

Separate required dependencies from optional dependencies.

SV-3 requires all dependencies, including the cache and broker, to be reachable before readiness. SV-9 requires graceful operation when a non-critical dependency is unavailable. Define which dependencies are required. Readiness must gate only on required dependencies.


46-49: 🗄️ Data Integrity & Integration | 🟠 Major | ⚡ Quick win

Define idempotency on message processing.

SV-12 says that messages published to a broker are idempotent. Duplicate side effects occur when a consumer processes the same message more than once. Rewrite this criterion for idempotent consumer processing. Add a separate producer requirement if duplicate publishes require deduplication or an idempotency key.


94-94: 🩺 Stability & Availability | 🟠 Major | ⚡ Quick win

Do not downgrade missing timeouts based on dependency availability.

An internal, highly available dependency can still hang or exhaust caller resources. Keep SV-6 and bounded retry behavior in SV-7 high regardless of the dependency SLA. Allow downgrades only when the criterion is proven not applicable and the evidence is documented.

.agents/docs/code-review/rubrics/web.md (1)

72-74: 🔒 Security & Privacy | 🟠 Major | ⚡ Quick win

Add an explicit CSRF criterion.

The scoring guidance classifies CSRF as critical, but this rubric has no CSRF checklist item. Add a criterion for state-changing requests, or explicitly require the security.md S-23 check.

.agents/docs/code-review/templates/scope.md (1)

14-18: 🗄️ Data Integrity & Integration | 🟠 Major | ⚡ Quick win

Include every supported rubric in Review type.

The template lists only general, security, performance, and api, but the repository also defines architecture, database, observability, SDK, service, testability, and web rubrics. A scope document cannot select those review layers. Use a free-form list or include all supported rubric names with a defined multi-value format.

.agents/docs/code-review/templates/scorecard.md (1)

20-28: 🗄️ Data Integrity & Integration | 🟠 Major | ⚡ Quick win

Keep verdict values consistent across summary and scorecard.

The canonical workflow uses lowercase pass, pass with conditions, and fail. Both templates must use those exact values.

  • .agents/docs/code-review/templates/scorecard.md#L20-L28: replace uppercase and title-case verdict values with lowercase values.
  • .agents/docs/code-review/templates/summary.md#L18-L20: replace the uppercase health-verdict placeholder with lowercase values.
📍 Affects 2 files
  • .agents/docs/code-review/templates/scorecard.md#L20-L28 (this comment)
  • .agents/docs/code-review/templates/summary.md#L18-L20
.agents/skills/scan-codebase/SKILL.md (1)

58-60: 🗄️ Data Integrity & Integration | 🟠 Major | ⚡ Quick win

Reconcile the findings record before writing it.

The scan starts from fresh context, then updates an existing path/findings.md. The workflow does not define how to match new observations to existing IDs or preserve open, closed, and user-decision statuses. A repeated scan can create duplicates or reopen a closed finding.

Add a reconciliation step after the fresh review and before the record update. Use the shared schema and lifecycle rules.

Suggested workflow change
-4. Update the active findings record.
+4. Reconcile new findings with the active record.
+   Match findings by stable ID or equivalent evidence.
+   Preserve existing statuses and user dispositions.
+5. Update the active findings record.
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

4. Reconcile new findings with the active record.
   Match findings by stable ID or equivalent evidence.
   Preserve existing statuses and user dispositions.
5. Update the active findings record.
   Use `path/findings.md`.

.agents/skills/shared/references/findings.schema.md (1)

109-118: 🗄️ Data Integrity & Integration | 🟠 Major | ⚡ Quick win

Define one canonical severity mapping.

The schema prefers P0P3, while the scorecard counts critical, high, medium, and low, and the rubrics use those names. An agent following this schema can produce P0 findings that the scorecard cannot count. Choose one vocabulary or define a mandatory mapping such as P0=critical, P1=high, P2=medium, and P3=low.

.agents/skills/sync-findings/SKILL.md (1)

54-61: 🗄️ Data Integrity & Integration | 🟠 Major | ⚡ Quick win

Reorder source discovery and the mandatory save.

The workflow requires path/findings.md to contain every new PR comment or scan observation before source reconciliation runs. The agent cannot identify those sources at that point. It also refreshes ## Summary before the record is current. This can create incomplete or duplicate findings.

First reconcile local and optional GitHub sources. Then write new findings and refresh the summary before proposing fixes or mutating threads.

Also applies to: 63-66, 76-78

@dosubot dosubot Bot added the lgtm This PR has been approved by a maintainer label Jul 31, 2026
@mmabrouk

Copy link
Copy Markdown
Member

Thanks @ashrafchowdury much needed

@mmabrouk
mmabrouk merged commit cf8a9bd into main Jul 31, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

lgtm This PR has been approved by a maintainer refactoring A code change that neither fixes a bug nor adds a feature size:XS This PR changes 0-9 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants