ci(coverage): Add test coverage report#12607
Draft
lucasssvaz wants to merge 1 commit into
Draft
Conversation
lucasssvaz
added
the
Type: CI & Testing
Contributor
👋 Hello lucasssvaz, we appreciate your contribution to this project! 📘 Please review the project's Contributions Guide for key guidelines on code, documentation, testing, and more. 🖊️ Please also make sure you have read and signed the Contributor License Agreement for this project. Click to see more instructions ...
Review and merge process you can expect ...
|
lucasssvaz
force-pushed
the
feat/test_coverage
branch
from
0f62231 to
93ddd83
Compare
![github-advanced-security[bot]](https://avatars.githubusercontent.com/in/57789?s=60&v=4){kind=small}
| if gcov_tool: | ||
| cmd += ["--gcov-tool", gcov_tool] | ||
| print(f"$ {' '.join(cmd)}", file=sys.stderr) | ||
| result = subprocess.run(cmd, capture_output=True, text=True) |
| merge_cmd += ["--add-tracefile", pf] | ||
| merge_cmd += ["--output-file", tracefile, "--ignore-errors", "empty"] | ||
| print(f"$ {' '.join(merge_cmd)}", file=sys.stderr) | ||
| subprocess.run(merge_cmd, check=True) |
|
|
||
| try: | ||
| result = subprocess.run( | ||
| [cxxfilt], input="\n".join(mangled), |
| next(gen) # run up to yield | ||
| try: | ||
| next(gen) # run teardown | ||
| except StopIteration: |
| if clean: | ||
| try: | ||
| decoded_parts.append(base64.b64decode(clean)) | ||
| except Exception: |
| demangled = result.stdout.strip().splitlines() | ||
| if len(demangled) == len(mangled): | ||
| return dict(zip(mangled, demangled)) | ||
| except (FileNotFoundError, subprocess.TimeoutExpired): |
| if core_root: | ||
| try: | ||
| display_path = os.path.relpath(sf, core_root) | ||
| except ValueError: |
Contributor
Test Results 108 files 108 suites 29m 20s ⏱️ Results for commit 93ddd83. |
Contributor
Memory usage test (comparing PR against master branch)The table below shows the summary of memory usage change (decrease - increase) in bytes and percentage for each target.
Click to expand the detailed deltas report [usage change in BYTES]
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
lucasssvaz
added
the
Status: Blocked upstream 🛑
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description of Change
This pull request introduces a new test suite for the
conftest.pyfixtures and expands and refactors the existing test suite forruntime_table_generator.py. The changes improve test coverage, add new test cases (especially for coverage badge logic), and enhance test robustness and maintainability. The most important changes are:New Test Suite for conftest.py Fixtures:
.github/scripts/ci_testing/test_conftest_fixtures.py, a comprehensive test module for thecoverage_capture,gcov_dump_capture,save_perf_result, and related helpers fromconftest.py. This suite mocks dependencies and tests fixture logic without requiring hardware or pytest-embedded.Refactoring and Expansion of runtime_table_generator.py Tests:
.github/scripts/test_runtime_table_generator.pyto.github/scripts/ci_testing/test_runtime_table_generator.py, updating all references and usage instructions accordingly.run_generator, ensuring compatibility and clarity. [1] [2] [3] [4] [5] [6] [7] [8] [9]New Coverage Badge Test Cases:
Path and Import Robustness Improvements:
These changes collectively improve the reliability and coverage of the CI test scripts and ensure that future changes to test fixtures and runtime table generation logic are well-tested.
Test Scenarios
Tested locally
Related links
Requires espressif/pytest-embedded#420