Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The skill-score is no longer being calculated in the srw_metric.sh test #1150

Open
MichaelLueken opened this issue Nov 6, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@MichaelLueken
Copy link
Collaborator

Expected behavior

The current .cicd/scripts/srw_metrics.sh test should successfully run and compute the skill-score from the output.

Current behavior

The skill-score isn't being calculated because the data in the Indy-Severe-Weather.tgz file was created using release-public-v2.1.0. The postxconfig-NT-fv3lam.txt control file was updated with the version of the ufs-weather-model and UPP that were merged into develop at 87b26cc, replacing PRSML with MSLET, which is now causing the skill-score to not be calculated for PRSML (or MSLET, both pressure variables were tested and both fail to calculate the skill-score).

Machines affected

This affects all machines.

Steps To Reproduce

  1. Clone the develop branch.
  2. Set the necessary variables to run the Jenkins srw_metrics.sh script:
export WORKSPACE=(path of your ufs-srweather-app folder)
export SRW_PLATFORM=(e.g., orion)
export SRW_COMPILER=(e.g., intel)
export SRW_PROJECT=(e.g., epic)
  1. Run the srw_metrics.sh script - ./.cicd/scripts/srw_metric_example.sh
  2. Instead of a value, the script will return SS_INDEX, while giving warning messages that the skill-score couldn't be calculated for two fields.

Detailed Description of Fix (optional)

To get around this issue now and allow the skill-score to once again get calculated, PRSML will need to be removed from parm/metplus/STATAnalysisConfig_skill_score. While working the SRW release in PI15, if we can replace the release-public-v2.1.0 data with data that uses the updated postxconfig-NT-fv3lam.txt file, then we should be able to add pressure back as MSLET.

@MichaelLueken MichaelLueken added the bug Something isn't working label Nov 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant