Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wind direction stats and plots for global wave #671

Merged
merged 11 commits into from
Mar 4, 2025

Conversation

QiShi-NOAA
Copy link
Contributor

Note to developers: You must use this PR template!

Description of Changes

Please include a summary of the changes and the related GitHub issue(s). Please also include relevant motivation and context.

This PR adds wind direction verification metrics (dir_me, dir_mae and dir_rmse) for global wave.

Developer Questions and Checklist

  • Is this a high priority PR? If so, why and is there a date it needs to be merged by? No
  • Do you have any planned upcoming annual leave/PTO? No
  • Are there any changes needed in the times when the jobs are supposed to run/kick-off? Yes, it's need for GFS official verification.
  • The code changes follow NCO's EE2 Standards.
  • Developer's name is removed throughout the code and have used ${USER} where necessary throughout the code.
  • References the feature branch for HOMEevs are removed from the code.
  • J-Job environment variables, COMIN and COMOUT directories, and output follow what has been defined for EVS.
  • Jobs over 15 minutes in runtime have restart capability.
  • If applicable, changes in the dev/drivers/scripts or dev/modulefiles have been made in the corresponding ecf/scripts and ecf/defs/evs-nco.def?
  • Jobs contain the appropriate file checking and don't run METplus for any missing data.
  • Code is using METplus wrappers structure and not calling MET executables directly.
  • Log is free of any ERRORs or WARNINGs.

Testing Instructions

Please include testing instructions for the PR assignee. Include all relevant input datasets needed to run the tests.
Clone my fork https://github.com/QiShi-NOAA/EVS.git
Checkout the branch feature/wind_direction
Link to the fix directory.
Run jevs_global_det_gfs_wave_grid2obs_stats.sh and jevs_global_det_wave_grid2obs_plots_last*.sh to test.
The archived stats for plotting is located at: /lfs/h2/emc/vpppg/noscrub/qi.shi/EVS_wind_direction/evs/v2.0

@malloryprow malloryprow self-assigned this Feb 26, 2025
@malloryprow malloryprow added the enhancement New feature or request label Feb 26, 2025
@malloryprow malloryprow added this to the EVS v2.0.0 milestone Feb 26, 2025
@malloryprow
Copy link
Contributor

malloryprow commented Feb 26, 2025

1. jevs_global_det_gfs_wave_grid2obs_stats.sh

Log File: /lfs/h2/emc/vpppg/noscrub/mallory.row/verification/EVS_PRs/pr671/EVS/dev/drivers/scripts/stats/global_det/jevs_global_det_gfs_wave_grid2obs_stats_00.o181716267
DATA: /lfs/h2/emc/stmp/mallory.row/evs_test/prod/tmp/jevs_global_det_gfs_wave_grid2obs_stats_00.181716267.cbqs01
COMOUT: /lfs/h2/emc/vpppg/noscrub/mallory.row/verification/EVS_PRs/pr671/evs/v2.0/stats/global_det

@QiShi-NOAA
Copy link
Contributor Author

QiShi-NOAA commented Feb 26, 2025 via email

@QiShi-NOAA
Copy link
Contributor Author

QiShi-NOAA commented Feb 26, 2025 via email

@malloryprow
Copy link
Contributor

I saw that too. I don't think that is anything we can control and is related to things on WCOSS2.

@@ -719,7 +719,7 @@ def __init__(self):
'DPT': 'Dewpoint Temperature',
'UGRD': 'Zonal Wind Speed',
'VGRD': 'Meridional Wind Speed',
'UGRD_VGRD': 'Vector Wind Speed',
'UGRD_VGRD': 'Wind Direction',
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If 'UGRD_VGRD' has been changed to 'Wind Direction', what is being used for 'Vector Wind Speed' (which is something we would still like to verify out of EVS)? Are the U and V Wind Speed components being used for that? I'd hate to remove something we still want. Thanks!

CC @QiShi-NOAA @malloryprow

Copy link
Contributor

@AliciaBentley-NOAA AliciaBentley-NOAA Feb 26, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

May have answered my own question:
'UGRD_VGRD10m': 'Surface Vector Wind Speed',

Is this the replacement?

CC @QiShi-NOAA @malloryprow

Copy link
Contributor

@AliciaBentley-NOAA AliciaBentley-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have reviewed this PR and think that it looks very good! I asked one question about continuing to verify vector wind speed once that parameter was changed to 'wind direction', but I scrolled down and believe wind speed was added back later in the same file under a new name. I approve this PR to be merged after successful testing (e.g., proof that wind direction AND wind speed verification looks good). Thanks!

CC @malloryprow @QiShi-NOAA

@QiShi-NOAA
Copy link
Contributor Author

QiShi-NOAA commented Feb 26, 2025 via email

@malloryprow
Copy link
Contributor

For Wind Speed, global_det wave is using the "WIND" variable. 'UGRD_VGRD' is technically Vector Winds but global_det wave isn't using that.

So the changes work, but if statements may be useful to prevent any problems in the future.

@QiShi-NOAA
Copy link
Contributor Author

QiShi-NOAA commented Feb 26, 2025 via email

Qi Shi added 2 commits February 26, 2025 18:57
to wind direction) for wind direction
modify the file name in global_det_wave_plots comments section
stats  plot in time series.py and lead_average.py
@QiShi-NOAA
Copy link
Contributor Author

QiShi-NOAA commented Feb 26, 2025 via email

@malloryprow
Copy link
Contributor

COMOUT is /lfs/h2/emc/vpppg/noscrub/mallory.row/verification/EVS_PRs/pr671/evs/v2.0/plots/global_det/wave.20250226.

1. jevs_global_det_wave_grid2obs_plots_last31days

Log File: /lfs/h2/emc/vpppg/noscrub/mallory.row/verification/EVS_PRs/pr671/EVS/dev/drivers/scripts/plots/global_det/jevs_global_det_wave_grid2obs_plots_last31days_00.o181817051
DATA: /lfs/h2/emc/stmp/mallory.row/evs_test/prod/tmp/jevs_global_det_wave_grid2obs_plots_last31days_00.181817051.cbqs01

2. jevs_global_det_wave_grid2obs_plots_last90days

Log File: /lfs/h2/emc/vpppg/noscrub/mallory.row/verification/EVS_PRs/pr671/EVS/dev/drivers/scripts/plots/global_det/jevs_global_det_wave_grid2obs_plots_last90days_00.o181817063
DATA: /lfs/h2/emc/stmp/mallory.row/evs_test/prod/tmp/jevs_global_det_wave_grid2obs_plots_last90days_00.181817063.cbqs01

@malloryprow
Copy link
Contributor

@QiShi-NOAA The jobs are done running. Yesterday in the global meeting you mentioned you updated the website to display the images. Can you put them the website and send a link to it?

@QiShi-NOAA
Copy link
Contributor Author

QiShi-NOAA commented Feb 27, 2025 via email

@QiShi-NOAA
Copy link
Contributor Author

QiShi-NOAA commented Feb 27, 2025 via email

@malloryprow
Copy link
Contributor

I think we may want to take "Wind Direction" out of the titles and webpage drop down. This would be more consistent with the other plots and webpages for global_det wave.

"Mean Absolute Wind Direction Difference" -> "Mean Absolute Error"
"Mean Wind Direction Difference" -> "Mean Error (Bias)"
"Root Mean Square Wind Direction Difference" -> "Root Mean Square Error"

@QiShi-NOAA
Copy link
Contributor Author

QiShi-NOAA commented Feb 27, 2025 via email

@QiShi-NOAA
Copy link
Contributor Author

QiShi-NOAA commented Feb 27, 2025 via email

@malloryprow
Copy link
Contributor

COMOUT is /lfs/h2/emc/vpppg/noscrub/mallory.row/verification/EVS_PRs/pr671/evs/v2.0/plots/global_det/wave.20250226 (cleared out before rerunning).

1. jevs_global_det_wave_grid2obs_plots_last31days

Log File: /lfs/h2/emc/vpppg/noscrub/mallory.row/verification/EVS_PRs/pr671/EVS/dev/drivers/scripts/plots/global_det/jevs_global_det_wave_grid2obs_plots_last31days_00.o181831674
DATA: /lfs/h2/emc/stmp/mallory.row/evs_test/prod/tmp/jevs_global_det_wave_grid2obs_plots_last31days_00.181831674.cbqs01

2. jevs_global_det_wave_grid2obs_plots_last90days

Log File: /lfs/h2/emc/vpppg/noscrub/mallory.row/verification/EVS_PRs/pr671/EVS/dev/drivers/scripts/plots/global_det/jevs_global_det_wave_grid2obs_plots_last90days_00.o181831675
DATA: /lfs/h2/emc/stmp/mallory.row/evs_test/prod/tmp/jevs_global_det_wave_grid2obs_plots_last90days_00.181831675.cbqs01

@QiShi-NOAA
Copy link
Contributor Author

QiShi-NOAA commented Feb 27, 2025 via email

@AliciaBentley-NOAA
Copy link
Contributor

@QiShi-NOAA Can you please sync your fork? Shannon's subseasonal PR was merged earlier today. Also, does anything else need to be rerun on this PR before it is merged?

CC @PerryShafran-NOAA

@QiShi-NOAA
Copy link
Contributor Author

QiShi-NOAA commented Mar 4, 2025 via email

@PerryShafran-NOAA
Copy link
Contributor

@QiShi-NOAA I'll be doing the final code review and then I'll merge this code.

Copy link
Contributor

@PerryShafran-NOAA PerryShafran-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code changes work as expected. Approved for merge.

@PerryShafran-NOAA PerryShafran-NOAA merged commit dd464bf into NOAA-EMC:develop Mar 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants