Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Remove pslot dir from local archive folder on CI case completion #2961

Closed
wants to merge 36 commits into from
Closed

Remove pslot dir from local archive folder on CI case completion #2961

wants to merge 36 commits into from

Commits on Sep 24, 2024

  1. added a cleanup_experment funciton to ci_utils that cleans local arch… 

    …rive files
    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    1c159d8 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. Merge branch 'NOAA-EMC:develop' into ci_clean_loc_arch

    @TerrenceMcGuinness-NOAA
    TerrenceMcGuinness-NOAA authored Sep 25, 2024
    Configuration menu
    Copy the full SHA
    e7aa3ba View commit details
    Browse the repository at this point in the history

  2. moved rm for EXPDIR into cleanup_expermiment function

    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    463655a View commit details
    Browse the repository at this point in the history

  3. Merge branch 'ci_clean_loc_arch' of github.com:TerrenceMcGuinness-NOA… 

    …A/global-workflow into ci_clean_loc_arch
    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    b511367 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. fixed bracket sytax error in ci_utils and missnamed function call in … 

    …Jenkins file to cleanup experiment
    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    40c96b2 View commit details
    Browse the repository at this point in the history

  2. fixed SC2155 in bash utils for cleanup

    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    54ce216 View commit details
    Browse the repository at this point in the history

  3. fixed SC2115 for var expation in path for clean experiment util

    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    cacde8c View commit details
    Browse the repository at this point in the history

  4. needed the OR truch for var assigment via actions in bash

    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    c8a10a9 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. fixed the evaluation of HOMDIR so that internal strification of env v… 

    …ars work in cleanup_experiment
    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    7c93f4b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' into ci_clean_loc_arch

    @TerrenceMcGuinness-NOAA
    TerrenceMcGuinness-NOAA authored Sep 27, 2024
    Configuration menu
    Copy the full SHA
    bb92a39 View commit details
    Browse the repository at this point in the history

  3. still needed archive tagged back onto HOMEDIR

    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    bfcbba5 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'ci_clean_loc_arch' of github.com:TerrenceMcGuinness-NOA… 

    …A/global-workflow into ci_clean_loc_arch
    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    69fc51b View commit details
    Browse the repository at this point in the history

  5. new linee at aend of ci_utils

    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    49b4489 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. Merge branch 'NOAA-EMC:develop' into ci_clean_loc_arch

    @TerrenceMcGuinness-NOAA
    TerrenceMcGuinness-NOAA authored Oct 23, 2024
    Configuration menu
    Copy the full SHA
    b776a59 View commit details
    Browse the repository at this point in the history

  2. removed eval in cleanup_experiment and added envsubst at end of pipe … 

    …instead
    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    d8af194 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2024

  1. updated archival directory to ARCDIR from config.base in cleanup_expe… 

    …riment
    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    d54bd8d View commit details
    Browse the repository at this point in the history

  2. forgot to clean up EXPDIR replacement in cleanup_experment

    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    85f6369 View commit details
    Browse the repository at this point in the history

  3. forgot to clean up EXPDIR replacement in cleanup_experment still

    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    6a09b36 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. Update ci/scripts/utils/ci_utils.sh 

    of course, duh ◔_◔

Co-authored-by: David Huber <[email protected]>
    @TerrenceMcGuinness-NOAA @DavidHuber-NOAA
    TerrenceMcGuinness-NOAA and DavidHuber-NOAA authored Oct 25, 2024
    Configuration menu
    Copy the full SHA
    32b8cd0 View commit details
    Browse the repository at this point in the history

Commits on Nov 5, 2024

  1. added get_config_var util to simplify cleanup_experment

    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    e01d9d3 View commit details
    Browse the repository at this point in the history

  2. removed debug outputs in cleanup_experiment

    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    3d5e851 View commit details
    Browse the repository at this point in the history

  3. added next step to use get_config_var to remove previous DATAROOT dat… 

    …a when startig new experimentsa
    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    162474a View commit details
    Browse the repository at this point in the history

  4. fix conficts and merged develop back in

    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    7da3721 View commit details
    Browse the repository at this point in the history

  5. updated Jenkinsfile to use clean experiment and to also clean DATADIR… 

    … in advance of running a experiment for the case that it had already ran
    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    c6ad4ec View commit details
    Browse the repository at this point in the history

  6. updating correct ATARDIR variable in cleaup

    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    bef32e7 View commit details
    Browse the repository at this point in the history

  7. added true for shell norms

    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    02642fc View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2024

  1. Update ci/scripts/utils/ci_utils.sh 

    Of course, love it.

Co-authored-by: David Huber <[email protected]>
    @TerrenceMcGuinness-NOAA @DavidHuber-NOAA
    TerrenceMcGuinness-NOAA and DavidHuber-NOAA authored Nov 6, 2024
    Configuration menu
    Copy the full SHA
    62ec3f6 View commit details
    Browse the repository at this point in the history

  2. Update ci/scripts/utils/ci_utils.sh 

    oh sure, yes. Notice also we do the DATAROOT remove independent of the cleanup_experiment before it is ran again in Jenkins.

Co-authored-by: David Huber <[email protected]>
    @TerrenceMcGuinness-NOAA @DavidHuber-NOAA
    TerrenceMcGuinness-NOAA and DavidHuber-NOAA authored Nov 6, 2024
    Configuration menu
    Copy the full SHA
    7e5b4fb View commit details
    Browse the repository at this point in the history

  3. Update ci/scripts/utils/get_config_var.py 

    Co-authored-by: David Huber <[email protected]>
    @TerrenceMcGuinness-NOAA @DavidHuber-NOAA
    TerrenceMcGuinness-NOAA and DavidHuber-NOAA authored Nov 6, 2024
    Configuration menu
    Copy the full SHA
    bf3b80f View commit details
    Browse the repository at this point in the history

  4. Update ci/scripts/utils/get_config_var.py 

    que?

Co-authored-by: David Huber <[email protected]>
    @TerrenceMcGuinness-NOAA @DavidHuber-NOAA
    TerrenceMcGuinness-NOAA and DavidHuber-NOAA authored Nov 6, 2024
    Configuration menu
    Copy the full SHA
    cd4e27b View commit details
    Browse the repository at this point in the history

  5. Update ci/scripts/utils/get_config_var.py 

    que que

Co-authored-by: David Huber <[email protected]>
    @TerrenceMcGuinness-NOAA @DavidHuber-NOAA
    TerrenceMcGuinness-NOAA and DavidHuber-NOAA authored Nov 6, 2024
    Configuration menu
    Copy the full SHA
    5ea8d3d View commit details
    Browse the repository at this point in the history

  6. Update ci/scripts/utils/get_config_var.py 

    que que que

Co-authored-by: David Huber <[email protected]>
    @TerrenceMcGuinness-NOAA @DavidHuber-NOAA
    TerrenceMcGuinness-NOAA and DavidHuber-NOAA authored Nov 6, 2024
    Configuration menu
    Copy the full SHA
    99b9322 View commit details
    Browse the repository at this point in the history

  7. Update ci/scripts/utils/get_config_var.py 

    que que que que

Co-authored-by: David Huber <[email protected]>
    @TerrenceMcGuinness-NOAA @DavidHuber-NOAA
    TerrenceMcGuinness-NOAA and DavidHuber-NOAA authored Nov 6, 2024
    Configuration menu
    Copy the full SHA
    f56be33 View commit details
    Browse the repository at this point in the history

  8. fixed name of get_config_var in pipeline (left off the py extention)

    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    9a381b4 View commit details
    Browse the repository at this point in the history

  9. DATAROOT is not a config.base value but is construced from STMP in ta… 

    …sks.py
    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    788dd8f View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2024

  1. updated Jenkins file with correct RUNDIRS string (had RUNDIR as a bug)

    @TerryMcGuinness-NOAA
    TerryMcGuinness-NOAA committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    7d3b8bf View commit details
    Browse the repository at this point in the history