-
Notifications
You must be signed in to change notification settings - Fork 55
π€ π Copilot on Rails #1615
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. Weβll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
Matthew Fisher (MicroFish91)
wants to merge
192
commits into
main
Choose a base branch
from
feat/CoR
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from 73 commits
Commits
Show all changes
192 commits
Select commit
Hold shift + click to select a range
8044301
Remove Copilot on Rails feature
70dd310
Revert "Remove Copilot on Rails feature"
a59a761
Update Copilot on Rails views (#1449)
motm32 b9eaca9
Add `azure-debug-plan` custom agent and instructions (#1475)
MicroFish91 be42ab1
Add `azure-debug-generate` custom agent and instructions (#1478)
MicroFish91 4605511
Move skills to resources/agents instruction files (#1482)
nturinski bb92297
Improvements to dependency instructions for `azure-debug-generate` (#β¦
MicroFish91 a593097
Allow executing debug configurations in the project view (#1485)
MicroFish91 12b3b12
Improvements to compound launch/tasks & make sure TypeScript source mβ¦
MicroFish91 9da8efa
add ui preview to planning doc (#1484)
nturinski 4355450
Add command to download agent instruction files to workspace (#1488)
nturinski a151b0d
Add activation events for our extension when we detect CoR artifacts β¦
nturinski 96eeffe
Change instructions to rename src folder to services for monorepos (#β¦
nturinski 8e50ce2
Give folder names more service specific names (#1499)
nturinski f24654a
Improvements to prerequisite finding for `azure-debug-plan` (#1505)
MicroFish91 501d137
Autopilot Mode (#1497)
nturinski 729299d
Make changes for accessibility and add loading view (#1494)
motm32 3910d84
Add fixes for next steps views to work properly (#1510)
motm32 48a5800
Forbid creating anything that is not app code (#1500)
nturinski f271d0a
Add prerequisite refresh (#1512)
motm32 205a334
Use a more service-centric planning paradigm (#1508)
nturinski f08ac6d
Fix view issues (#1513)
motm32 a432d9c
Make prerequisites logic shared, add a prerequisites view to the scafβ¦
MicroFish91 feae13c
Improve loading responsiveness of preview UI and add ability to writeβ¦
MicroFish91 6ccc4af
Add azure-project-integrate agent instructions (#1514)
nturinski ed8500f
Update instructions to properly capture multiple data stores on requiβ¦
MicroFish91 4f7a2f6
Nat/integrate integration (#1517)
nturinski b881197
Fix comments showing up in the debug plan webview (#1520)
MicroFish91 61f52f3
add fix (#1521)
motm32 b0b4b51
Add refresh to scaffold prerequisites view (#1522)
motm32 b0ea35e
Fix feedback drawer issues (#1523)
motm32 9c26061
Multiple improvements to prerequisites listing and installation warniβ¦
MicroFish91 6b737d2
Improve prerequisites detection (#1526)
MicroFish91 6e000d5
Fix lint for build (#1527)
MicroFish91 9679e7e
Add a warning about using python/.net (#1524)
nturinski 44c8f4a
Increase max requests when using copilot on rails flow (#1531)
nturinski a634887
Change warning labels and remove some verbose comments (#1534)
nturinski 94c698e
UI changes from feedback (#1529)
motm32 fab8c70
Greatly improve performance of requirements.json. (#1542)
nturinski 47959c4
More UI fixes (#1541)
motm32 09c920e
Add "Create with Copilot" button when no folder is opened (#1544)
motm32 39e1613
Resume session (#1543)
nturinski f1d22c8
Increase max width (#1548)
motm32 b990c5a
Improve the UX preview plan project (#1545)
nturinski 2eb35c2
CoR: Cherry pick MCP support, add CoR commands as MCP, wrap commands β¦
MicroFish91 9ee7255
Make it so autopilot carries over to new instances (#1539)
motm32 d0505fa
Add loading view for Running API tests (#1553)
motm32 6dec530
Requested small UI changes (#1551)
motm32 fef3b15
CoR: Add browser detection as part of identifying prerequisites and aβ¦
MicroFish91 b3ed02f
Add a "Report issue" button to the loading views (#1559)
motm32 628fd83
Add a "Need help" button to loading views so users can easily resume β¦
motm32 14daf4c
CoR: Record local diagnostics metadata for originating prompt and creβ¦
MicroFish91 3605877
Add warning for Azure resources emulators with limited support (#1554)
motm32 a2b204a
Add telemetry for refreshing prerequisites (#1567)
motm32 b673f13
Add no-datastore project requirement (#1572)
alexweininger b365edc
Wait for custom agents before launch (#1571)
alexweininger 7fe3664
Add a model selector to the landing page (#1573)
motm32 c2c9e48
Add telemetry for next steps buttons (#1566)
motm32 968131f
Improve deployment plan parsing (#1574)
alexweininger 48df8ea
Open next steps view again after API tests are run (#1595)
motm32 4b70b20
Add telemetry and diagnostics for interactions with the local debug pβ¦
MicroFish91 ecbff45
Add telemetry and diagnostics for interactions with the project scaffβ¦
MicroFish91 8cbdcf6
Add telemetry and diagnostic for interactions with the requirements vβ¦
motm32 8179c86
Add telemetry and diagnostics for interactions with the deployment plβ¦
MicroFish91 62e7700
Add some missing plan telemetry points (#1602)
MicroFish91 e2ce62c
CoR: Record ISO timestamps (#1605)
MicroFish91 74356cb
CoR: Record basic system / model specs for telemetry and diagnostics β¦
MicroFish91 3621f2e
CoR: Standardize command and telemetry ids (#1603)
MicroFish91 5cd76a9
CoR: Delete some dead code (#1612)
MicroFish91 bb9bb54
Add a warning for when the GHC4A extension/skills are not installed wβ¦
motm32 9cd0225
Record autopilot telemetry automatically for all CoR commands (#1613)
MicroFish91 05b883d
CoR: Improve prerequisites detection to be more shell agnostic (#1558)
MicroFish91 f69cab0
CoR: Add extra telemetry for `openWithChatAgent` family of functions β¦
MicroFish91 3e2d1e9
Change agent to always opening the requirements view (#1621)
motm32 d0574eb
CoR: Add a way to report issue to GitHub with attached diagnostics inβ¦
MicroFish91 0524202
Write the status for approved project plan (#1619)
motm32 14da9d0
Fix #1624: guard azd hook schema in deploy agent to stop deploy retryβ¦
alexweininger d48fffa
Fix JSON formatting in settings.json
nturinski 8d0c7b8
CoR: Remove `onStartupActivation` by making `Azure Project` view alwaβ¦
MicroFish91 c4c4786
Harden scaffold instructions so the Approve-UI preview iframe reliabyβ¦
nturinski 6dc06fa
Merge from main (#1630)
nturinski 7ba9115
Merge branch 'main' into feat/CoR
6372547
CoR: Separate system info recording behavior for diagnostics vs. teleβ¦
MicroFish91 ffeb780
add deploy-ready prebuilt artifact contract (#1643)
nturinski a867edc
CoR: Invoke extension commands through the VS Code API (#1640)
MicroFish91 9c2938a
CoR: Record debug plan approval telemetry even when autopilot is actiβ¦
MicroFish91 9961aa2
docs: add Create New Project with Copilot guide and support runbook (β¦
nturinski 8b26ba6
CoR: Add recent-prompt history navigation for prompts on the landing β¦
MicroFish91 070f507
CoR: More improvements to local debug agent instructions (#1663)
MicroFish91 84265ac
Use the app onboarding pipeline (#1665)
nturinski f794593
scaffold: document monorepo self-contained deploy; bundling optional β¦
nturinski d59a797
CoR: Add debug session watcher for project debug telemetry (#1666)
nturinski 936082f
Fix docker-compose credential corruption and blank local database creβ¦
alexweininger d9e058a
Merge branch 'main' into feat/CoR
Copilot 298f04a
Fix lint errors in azure-deploy agent reference schema files
Copilot b01c7ae
CoR: Remove unnecessary prompt input property from some mcp tools (#1β¦
MicroFish91 398f7ed
CoR: Add `debugAnyway` as a default workspace setting (#1677)
MicroFish91 d93a9c9
CoR: In autopilot, reuse project-plan prerequisites for the debug plaβ¦
MicroFish91 c586821
CoR: Ensure we are using the local harness during runs (#1680)
MicroFish91 309b01f
CoR: Resolve workspace trust errors that block GitHub Copilot Chat frβ¦
MicroFish91 4df6972
Add a deployment results view (#1687)
motm32 566e7f4
Add vally framework and graders for azure-project-plan (#1683)
motm32 d6e18de
Run the Vally project-plan eval on MSBench against a real extension bβ¦
alexweininger 55c2dda
Run the real Vally validators in MSBench as exec: assertions (#1695)
alexweininger 2b1e646
Convert the eval scripts to TypeScript (#1696)
alexweininger e4e719f
Stop run.sh from reporting throttled and raced runs as results (#1698)
alexweininger 28ac4d5
Raise the MSBench run timeouts so long end-to-end runs aren't killed β¦
alexweininger 9a2373a
Fix the evals lint break left by the TypeScript conversion (#1705)
alexweininger 3e47c9d
Verify what actually ran before trusting a run's results (#1701)
alexweininger a7449ca
Fail eval runs that die early instead of giving them partial credit (β¦
alexweininger 49930fa
Add `evals/msbench/regrade.ts`: re-grade past MSBench runs for zero tβ¦
alexweininger 5d4e031
Add the scaffold-phase eval gates from #1693 (#1707)
alexweininger 258482e
Add the local-debug eval gates from #1694 (#1708)
alexweininger bd0ed8f
Turn on MSBench run queueing, pin smoke mode off, and document the arβ¦
alexweininger 9dd6d8f
Remove .vally.yaml paths that point at directories that never existedβ¦
alexweininger 13d1561
Delete the retired headless eval runner (#1709)
alexweininger cabaa4e
Measure what a real multi-turn chain costs, with the first multi-turnβ¦
alexweininger ad41024
Count the sub-agent trajectories: reported uncached tokens were 2.5x β¦
alexweininger a41d578
Split the MSBench config into base, phase and stimulus layers (#1715)
alexweininger 551e0e8
Add fidelity gates: did the agent build what it planned? (#1721)
alexweininger 0d844fb
Audit the gates themselves, not just the product (#1718)
alexweininger fd85354
Add the runtime gates: does the generated project actually run? (#1719)
alexweininger c8ea2cf
Add a debug-breakpoint eval gate that hits a real breakpoint (#1717)
alexweininger 5853938
Stop the grader scanner reading English as code (#1727)
alexweininger 8f690c4
Refuse to audit a run MSBench has not marked complete (#1725)
alexweininger d196494
Make a project type a data file: the stack schema (#1726)
alexweininger fafab22
Let the health gate fail for the thing it exists to check (#1728)
alexweininger ed16387
Stop reporting "my parser found nothing" as "there is nothing to checβ¦
alexweininger 7c0d331
Derive which gates a stack runs, instead of hand-wiring them (#1731)
alexweininger 32c16ba
Flag gates that never fail and sometimes decline to answer (#1729)
alexweininger f3153fb
Record the part of a gate that nothing tests (#1732)
alexweininger ddbd1e7
Make "run.sh works on a clean machine" a check, not a comment (#1733)
alexweininger 9707d01
Read the stack declaration, and stop asserting that a worker listens β¦
alexweininger b4603a8
Stop two runtime gates requiring the declaration they consume (#1736)
alexweininger 03ce495
Tell gate-health which reds we already agreed to pay for (#1735)
alexweininger 0f8d171
Stop a typo in the gate table from silently unwiring a gate (#1737)
alexweininger a199d50
Make the unexplained gate rows visible rather than clean (#1738)
alexweininger 3d3336f
Stop the README implying the gate table is verified (#1739)
alexweininger 67e65f0
Stop demanding a Database section from a project that has no datastorβ¦
alexweininger cdf15ba
Wire the eight merged scaffold and debug graders to real MSBench stimβ¦
alexweininger dcad7cb
Make the deny-list the default way to say "this fact must be somethinβ¦
alexweininger 35a7070
Wire the debug probe into MSBench, plus one cheap run to prove it insβ¦
alexweininger fc75c88
Stop gate-health rebuilding the declared-gap key by hand (#1742)
alexweininger c735167
Fix five places the MSBench docs and config disagreed with themselvesβ¦
alexweininger fe6fd24
Fix the two things that were only ever wrong on the machine that mattβ¦
alexweininger 5c29c51
CoR: Β Add first-launch browser debugging troubleshooting guidance forβ¦
MicroFish91 4599961
CoR: Improve `azure-debug-generate` troubleshooting docs (#1745)
MicroFish91 f71349c
Probe the one mechanism a phase chain can still use, before building β¦
alexweininger 3318bc1
Report a gate that never ran as not-attempted, not as a failure (#1747)
alexweininger 9358472
CoR: Fix webview syntax error from apostrophes in initial data (#1748)
nturinski a872387
Fail the job when the assertions failed, instead of reporting green (β¦
alexweininger c635a49
Inventory ARM resources before and after deployment to give a clean uβ¦
nturinski f4c9037
CoR: Add safe install links for prerequisites and standardize format β¦
MicroFish91 2d4ee8c
Seed the scaffold phase from real planner output, and notice when it β¦
nturinski 14310d2
Fix lint failures in eval sources
Copilot 7a4e2fc
Fix duplicate deployment plan fields
Copilot 43df84f
Make the eval harness work on a clean Windows machine (#1751)
patverb 9c626fa
Find the frontend where the plan put it, and let certification move aβ¦
patverb 410c131
Measure the eval harness against itself: func, --dind, turn shape, anβ¦
nturinski 4b01667
Add deploy-stage iac-compiles gate (#1754)
patverb b8ea49e
Make the runtime gates able to run, and find out what they say (#1755)
nturinski e92551f
fix: don't force the debug view when iterating via Next Steps (#1761)
nturinski ccf4c4d
Runtime gates: resolve dependencies the way Node does, not by one dirβ¦
nturinski 7a6057f
fix: drop deprecated Claude Opus 4.6 from the model list (#1762)
nturinski 649bf84
fix: let users reopen the progress view after closing it early (#1760)
nturinski f25d5b0
Fix lint on feat/CoR: ignore grader-certification fixtures as a tree β¦
nturinski f7c4546
Scaffold: forbid tsconfig `paths` aliases for cross-workspace importsβ¦
nturinski 1b43164
safety-boundaries: count only what the agent wrote, so the gate can tβ¦
nturinski 730dd3b
Add 8 plan-phase scenario stimuli and two requirements grader flags (β¦
patverb 6f5ef67
Automate the red-team prompts that can be, and state why the rest canβ¦
nturinski 1a60759
Phase1: feat(copilot-on-rails): add Podman as a local-debug containerβ¦
nturinski 7b5d5f3
Prove the debug-breakpoint gate can run against a real Azure Functionβ¦
nturinski 5b3f38d
Seed the scaffold suites with a plan the planner would actually emit β¦
nturinski d35b65a
fix(copilot-on-rails): disable Approve on an already-approved deploymβ¦
nturinski 2f03f24
fix(msbench): resolve build lint errors
Copilot 48820eb
Say what the phase-reachability check actually proves (#1782)
nturinski 0bcc0e4
Give the sequenced compound task the runOptions its siblings get (#1783)
nturinski fc8ae3b
Check that the seeded plan is one the planner would emit (#1784)
nturinski a5fc47b
Stop treating msbench-cli extract's exit code as proof it extracted (β¦
nturinski c032dba
CoR: Add a deployment results view opener to the Azure Project tree (β¦
motm32 a74e183
Check that a stimulus asserts each MCP tool is called, not just that β¦
nturinski 276e6c8
Let a full refusal pass redteam-exfiltration-endpoint, anchored on enβ¦
nturinski 7491b18
feat(copilot-on-rails): add GPT-5.6 Sol and Terra to the model list (β¦
nturinski 5db163a
CoR: Don't show warning when only our downloaded files are in the worβ¦
motm32 4c1240c
Validate the model MSBench actually runs, and pin it to one the agentβ¦
nturinski 71d8acc
Revert "Validate the model MSBench actually runs, and pin it to one tβ¦
nturinski 761263a
fix(copilot-on-rails): stop auto-opening the Azure portal on deploy (β¦
nturinski a1ba9bf
CoR: Hide mermaid diagram if and error occurs rendering it (#1822)
motm32 4b558ba
CoR: Small UI Changes (#1816)
motm32 2c2424a
Mandatory managed identity, no secrets/passwords, no Key Vault (azureβ¦
nturinski c0a922b
Run post-deploy migrations via an access ladder instead of opening thβ¦
nturinski 5dacef3
CoR: Add telemetry for `azure-deploy` artifacts (#1831)
MicroFish91 File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -14,5 +14,5 @@ | |
| "dist": true, | ||
| "**/node_modules": true, | ||
| ".vscode-test": true | ||
| }, | ||
| } | ||
| } | ||
Large diffs are not rendered by default.
Oops, something went wrong.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.