Skip to content

feat(test-runner): add Reporter.plan() hook for test filtering#41100

Open
Skn0tt wants to merge 4 commits into
microsoft:mainfrom
Skn0tt:fix-40934
Open

feat(test-runner): add Reporter.plan() hook for test filtering#41100
Skn0tt wants to merge 4 commits into
microsoft:mainfrom
Skn0tt:fix-40934

Conversation

@Skn0tt
Copy link
Copy Markdown
Member

@Skn0tt Skn0tt commented Jun 2, 2026

Adds a Reporter.plan(rootSuite) hook that runs between onConfigure and onBegin, letting reporters filter/modify tests using skip/fixme/fail/exclude disposition methods on TestCase and Suite.

Reporters can also opt out of Playwright's built-in sharding by implementing implementsSharding().

Follow-up: expose Suite.parallelMode publicly so third-party sharders can keep test.describe.serial(...) chains together. Without it, custom sharding can only safely split tests that aren't in serial groups.

Fixes #40934

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026

Test results for "MCP"

7230 passed, 1103 skipped


Merge workflow run.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026

Test results for "tests 1"

4 flaky ⚠️ [chromium-library] › library/popup.spec.ts:261 › should not throw when click closes popup `@chromium-ubuntu-22.04-arm-node20`
⚠️ [chromium-library] › library/video.spec.ts:647 › screencast › should capture full viewport `@chromium-ubuntu-22.04-node22`
⚠️ [firefox-page] › page/page-emulate-media.spec.ts:144 › should keep reduced motion and color emulation after reload `@firefox-ubuntu-22.04-node20`
⚠️ [playwright-test] › ui-mode-test-filters.spec.ts:75 › should filter by status `@windows-latest-node20`

39543 passed, 775 skipped


Merge workflow run.

@Skn0tt Skn0tt marked this pull request as ready for review June 2, 2026 15:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature]: custom reporter API for test sharding

1 participant