Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Cheyenne to Derecho Script and Documentation Update #487

Merged
merged 1 commit into from
Jul 29, 2024
Merged

Cheyenne to Derecho Script and Documentation Update #487

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 7 additions & 7 deletions scm/doc/TechGuide/chap_cases.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -146,7 +146,7 @@ are included in ``ccpp-scm/scm/data/processed_case_input/fv3_model_point_noah[mp
.. literalinclude:: arm_case_header.txt
:name: lst_case_input_netcdf_header_arm
:caption: example NetCDF file (CCPP-SCM format) header for case initialization and forcing data

Case input data file (DEPHY format)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Expand Down Expand Up @@ -505,10 +505,10 @@ Optional arguments:
Examples to run from within the ``scm/etc/scripts`` directory to create SCM cases starting
with the output from a UFS Weather Model regression test(s):

On the supported platforms Cheyenne (NCAR) and Hera (NOAA), there are
On the supported platforms Derecho (NCAR) and Hera (NOAA), there are
staged UWM RTs located at:

- Cheyenne ``/glade/scratch/epicufsrt/GMTB/CCPP-SCM/UFS_RTs``
- Derecho ``/glade/derecho/scratch/epicufsrt/FV3_RT/``
- Hera ``/scratch1/BMC/gmtb/CCPP-SCM/UFS_RTs``

.. _`example1`:
Expand All @@ -520,7 +520,7 @@ UFS regression test, ``control_c192``, for single point.

.. code:: bash

./UFS_forcing_ensemble_generator.py -d /glade/scratch/epicufsrt/GMTB/CCPP-SCM/UFS_RTs/control_c192/ -sc --C_RES 192 -dt 360 -n control_c192 -lons 300 -lats 34
./UFS_forcing_ensemble_generator.py -d [path_to_regression_tests_output]/control_c192_intel/ -sc --C_RES 192 -dt 360 -n control_c192 -lons 300 -lats 34

Upon successful completion of the script, the command to run the case(s)
will print to the screen. For example,
Expand All @@ -540,7 +540,7 @@ UFS regression test, ``control_c384``, for multiple points.

.. code:: bash

./UFS_forcing_ensemble_generator.py -d /glade/scratch/epicufsrt/GMTB/CCPP-SCM/UFS_RTs/control_c384/ -sc --C_RES 384 -dt 225 -n control_c384 -lons 300 300 300 300 -lats 34 35 35 37
./UFS_forcing_ensemble_generator.py -d /glade/derecho/scratch/epicufsrt/ufs-weather-model/RT/NEMSfv3gfs/develop-20240607/control_c384_intel/ -sc --C_RES 384 -dt 225 -n control_c384 -lons 300 300 300 300 -lats 34 35 35 37

Upon successful completion of the script, the command to run the case(s)
will print to the screen. For example,
Expand Down Expand Up @@ -578,14 +578,14 @@ for more details.

For the purposes of this example the ``control_p8`` test has already been rerun, but if
starting from your own UWM RTs, you can rerun the UWM regression test,
on Cheyenne for example, by running the following command in the RT
on Derecho for example, by running the following command in the RT
directory: ``qsub job_card``

Now the cases can be generated with the following command:

.. code:: bash

./UFS_forcing_ensemble_generator.py -d /glade/scratch/epicufsrt/GMTB/CCPP-SCM/UFS_RTs/control_p8/ -sc --C_RES 96 -dt 720 -n control_p8 -lonl 300 320 -latl 40 50 -nens 10 -sdf SCM_GFS_v17_p8
./UFS_forcing_ensemble_generator.py -d /glade/derecho/scratch/epicufsrt/ufs-weather-model/RT/NEMSfv3gfs/develop-20240607/control_p8_intel -sc --C_RES 96 -dt 720 -n control_p8 -lonl 300 320 -latl 40 50 -nens 10 -sdf SCM_GFS_v17_p8

Upon successful completion of the script, the command to run the case(s)
will print to the screen. For example,
Expand Down
15 changes: 10 additions & 5 deletions scm/etc/scm_qsub_example.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,10 +3,15 @@
-----------------------------------------------------------------------
Description: Example script to submit a job through the HPC batch system

Assumptions: For use on Cheyenne. This script must be copied to the bin directory.
Assumptions: For use on Derecho. This script must be copied to the bin directory.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Has this been tested on Derecho? I don't think I ever tried out this example script in my Derecho testing.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Generalized this script more, testing right now, thanks for your input!

The user should edit the JOB_NAME, ACCOUNT, etc.
./scm/etc/Cheyenne_setup_intel.sh or
./scm/etc/Cheyenne_setup_gnu.sh must be run before submitting this script
Before running this script the environment must be setup.
The following are instructions for that:
$ module purge
$ module use scm/etc/modules
$ module load derecho_gnu
or
$ module load derecho_intel

Command line arguments: none

Expand All @@ -25,10 +30,10 @@

### Begin User-editable section ###
JOB_NAME = "test_job"
ACCOUNT = "p48503002"
ACCOUNT = "ENTER_ACCOUNT_NUMBER"
WALLTIME = "walltime=00:20:00"
PROCESSORS = "select=1:ncpus=1"
QUEUE = "share"
QUEUE = "develop"
COMMAND = "./run_scm.py -c twpice"
EMAIL_ADDR = MY_EMAIL
SERIAL_MEM = "512M"
Expand Down
Loading
Loading