Skip to content

Add RMSE scores based vertical pressure profile recipe and include pl…#2230

Draft
Sylvia Bohnenstengel (Sylviabohnenstengel) wants to merge 8 commits into
mainfrom
2229_scores_rmse_vertical_profile_pressure_levels
Draft

Add RMSE scores based vertical pressure profile recipe and include pl…#2230
Sylvia Bohnenstengel (Sylviabohnenstengel) wants to merge 8 commits into
mainfrom
2229_scores_rmse_vertical_profile_pressure_levels

Conversation

@Sylviabohnenstengel

@Sylviabohnenstengel Sylvia Bohnenstengel (Sylviabohnenstengel) commented Jun 24, 2026

Copy link
Copy Markdown
Member

…otting of vertical profiles without sequence_coordinate for 1D cubes.

Contribution checklist

Aim to have all relevant checks ticked off before merging. See the developer's guide for more detail.

  • Documentation has been updated to reflect change.
  • New code has tests, and affected old tests have been updated.
  • All tests and CI checks pass.
  • Ensured the pull request title is descriptive.
  • Ensure rose-suite.conf.example has been updated if new diagnostic added.
  • Attributed any Generative AI, such as GitHub Copilot, used in this PR.
  • Marked the PR as ready to review.

…otting of vertical profiles without sequence_coordinate for 1D cubes.
@github-actions

github-actions Bot commented Jun 24, 2026

Copy link
Copy Markdown
Contributor

Coverage

@Sylviabohnenstengel

Copy link
Copy Markdown
Member Author

Test figure for RMSE testing MODELB vs MODELB expecting RMSE=0.0 on all levels.
image

…tial field and preserve time as sequence coordinate to slide over. This required an addition to scoreswrappers.py that maps the xarray time dimensions with iris auxilliary time dimension requirements. The scoreswrapper was developed with help of Github copilot.
@Sylviabohnenstengel

Sylvia Bohnenstengel (Sylviabohnenstengel) commented Jun 24, 2026

Copy link
Copy Markdown
Member Author

Added capability to calculate the RMSE over the spatial domain on each layer for each timestep separately. This required a change to scores wrapper that matches the expected preserved dimensions that match xarray dimension names with the iris coordinates such as "time". The latter might be auxiliary coordinates attached to a differently named dimension such as dim0 so these needed matching.

Adding plots to show that recipe works for individual times as well.
This requires the addition of "time" to the preserved coordinate in the recipe when calling the scores_rmse wrapper.

image

@Sylviabohnenstengel Sylvia Bohnenstengel (Sylviabohnenstengel) added enhancement New feature or request full_review Requires a technical, scientific, and portability review labels Jun 25, 2026
…or rmse_scores_profile when aggregating over an entire case study's time coordinate resulting in a single rmse profile.
@Sylviabohnenstengel

Sylvia Bohnenstengel (Sylviabohnenstengel) commented Jun 25, 2026

Copy link
Copy Markdown
Member Author

Added aggregation period into title of profile RMSE plot. vertical plotting profile now recognises scalar sequence coordinates and uses them in the title/filename. In addition the output filename now includes the time range over which the RMSE was calculated.

Github copilot utilised for this commit.

Figures now shows the aggregation period when only preserving pressure and not time in the rmse calculation with scores.
image

If intending to plot individual rmse profiles for evevry time point then "time" needs to be added alongside "pressure" in the recipe when calling rmse scores. Figure below shows RMSe workign with date and time in title for a snapshot as well.
image

…teps in a case study and in additional rmse profile for evevry single time step.
… (sequence) and vertical profile RMSE over whole case. In addition identifying base_model at start of loader.
@Sylviabohnenstengel

Copy link
Copy Markdown
Member Author

vertical profiles of RMSE for a sequence such as time points as well as vertical profile of RMSE for whole case study are enabled independently of each other in the rose gui.

image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request full_review Requires a technical, scientific, and portability review

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Adding SCORES RMSE functionality to profiles.

1 participant