Repository navigation
chore(eval): add GPT-6.1 Sol and GPT-6 Luna to the 88-task and generate results - #2703
Merged
Merged
Conversation
… generate runs Claude-Session: https://claude.ai/code/session_015PWfrXwJG9NsMJqio8M1gW
Deploying with
|
| Status | Name | Latest Commit | Preview URL | Updated (UTC) |
|---|---|---|---|---|
| ✅ Deployment successful! View logs |
bashkit | 09ce5af | Commit Preview URL Branch Preview URL |
Oct 12 2026, 07:01 PM |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What changed
GPT-6.1 Sol and GPT-6 Luna are now included in the 2026-10-09 tagged
bashkit_bash(88 tasks) andbashkit_generate(15 tasks) runs. They were added withmira run --resume, which ran only their cases. The README table, the eval README results and the knowledge log now cover all seven models, and the homepage table picks up both models from the regenerated site data.Why
#2664 shipped with five models because the OpenAI key ran out of credit. Now that it has been topped up, the lineup is complete.
Before / After
Before: five models were on the 88-task set, and GPT-6 was missing from the homepage and the README.
After:
GPT-6.1 Sol is the only model besides Opus 5.5 that solves
hard_makefile_deps.Risk
Checklist
just check-okfandjust check-doc-linkspass)