Skip to content

Fix Retester Flakiness#540

Merged
0xOmarA merged 3 commits into
mainfrom
0xOmarA/fix-retester-indeterminism
Jun 2, 2026
Merged

Fix Retester Flakiness#540
0xOmarA merged 3 commits into
mainfrom
0xOmarA/fix-retester-indeterminism

Conversation

@0xOmarA
Copy link
Copy Markdown
Contributor

@0xOmarA 0xOmarA commented Jun 1, 2026

Description

Fixes issues with retester and some flakiness in tests. Issue is described in detail in paritytech/revive-differential-tests#296

Copy link
Copy Markdown
Member

@xermicus xermicus left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks

concurrency-number-of-concurrent-tasks: 50
# Use a sane value which is fast enough to make the tests run fast but not too
# fast that it overwhelms the node.
concurrency-number-of-concurrent-tasks: 1000
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How did you pick this number? On our hardware, is 1000 concurrent tasks actually faster than lets say 100?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's quite arbitrary to be honest, it's more of a trial and error and seeing what's best on the different machines.

Also, yes it does make things faster. https://github.com/paritytech/revive/actions/runs/26739486516/job/78802512016 took 37 minutes to run and this https://github.com/paritytech/revive/actions/runs/26776693394/job/78933925021 took 19 minutes to run so it's a good reduction

Copy link
Copy Markdown
Contributor

@elle-j elle-j left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@0xOmarA 0xOmarA merged commit 3a20436 into main Jun 2, 2026
31 checks passed
@elle-j elle-j deleted the 0xOmarA/fix-retester-indeterminism branch June 2, 2026 11:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants