Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add more CI to GW-CI #1365

Open
wants to merge 46 commits into
base: develop
Choose a base branch
from
Open

Add more CI to GW-CI #1365

wants to merge 46 commits into from

Conversation

DavidNew-NOAA
Copy link
Collaborator

@DavidNew-NOAA DavidNew-NOAA commented Nov 8, 2024

This PR is a companion to jcb-algorithms #7 and jcb-gdas #42. It does a couple things:

  1. 4 GW CI tests are added/extended as CTests in GDASApp, running through to the fcst jobs in the first full-cycle. These CI tests are: C96C48_hybatmDA, C96C48_ufs_hybatmDA, C96C48_hybatmaerosnowDA, and C48mx500_3DVarAOWCDA.
  2. Test references are added for C96C48_ufs_hybatmDA, so that we're actually testing the output, not just whether it cycles. This can be turned off in ``C96C48_ufs_hybatmDA.yaml``` if you just want.
  3. These CTests are turned on by default in a workflow build, rather than having to mess with the CMakeCache.txt file and re-running make. This will allow us to use these tests in nightly testing.
  4. test/gw-ci/CMakeLists.txt is refactored quite a bit.

The primary motivation for this PR is that we can run CI for our nightly testing of GDASApp. Also, anyone with a PR can easily do CI testing through CTests.

Note:

I'm not going to make a companion PR yet for the GW, because my branch will depend on #2992 being merged, but you can compare my branch to the branch for that PR here to see what it will do:

DavidNew-NOAA/global-workflow@feature/jcb-obsbias...DavidNew-NOAA:global-workflow:feature/gw-ci

Copy link
Contributor

@guillaumevernieres guillaumevernieres left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good @DavidNew-NOAA except for the missing gfsv17 test (c384/0.25). We don't want to run it a every pr's but it certainly needs to be checked regularly.

test/gw-ci/CMakeLists.txt Show resolved Hide resolved
@RussTreadon-NOAA
Copy link
Contributor

Question: do we expect reference checks to pass on all platforms? If not, on which platform(s) are the reference checks to be performed?

@DavidNew-NOAA
Copy link
Collaborator Author

DavidNew-NOAA commented Nov 8, 2024

@RussTreadon-NOAA I would expect them to pass within the tolerance that we set

CoryMartin-NOAA pushed a commit to NOAA-EMC/jcb-gdas that referenced this pull request Nov 8, 2024
This PR is a companion to
[#1365](NOAA-EMC/GDASApp#1365). It adds test
reference blocks to the YAMLs for the JEDI-to-FV3 increment converters.
@DavidNew-NOAA DavidNew-NOAA marked this pull request as ready for review November 8, 2024 15:10
@DavidNew-NOAA DavidNew-NOAA marked this pull request as draft November 8, 2024 15:13
@DavidNew-NOAA DavidNew-NOAA marked this pull request as ready for review November 8, 2024 15:14
CoryMartin-NOAA
CoryMartin-NOAA previously approved these changes Nov 8, 2024
@DavidNew-NOAA
Copy link
Collaborator Author

Reminder DO NOT MERGE this PR until GW PR #2992 is merged.

@DavidNew-NOAA DavidNew-NOAA added the DO NOT MERGE PR is not ready to be merged yet label Nov 8, 2024
danholdaway
danholdaway previously approved these changes Nov 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
DO NOT MERGE PR is not ready to be merged yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants