Workaround for data catalog race condition

ceblanton · Jan 29, 2025 · 01ed4be · 01ed4be
1 parent f4fa958
commit 01ed4be
Showing 1 changed file with 3 additions and 0 deletions.
diff --git a/flow.cylc b/flow.cylc
@@ -925,6 +925,9 @@ REMAP-PP-COMPONENTS-AV-{{ PP_CHUNK_B }}:succeed-all => clean-shards-{{ PP_CHUNK_
         # workaround to replace P1M with monthly
         sed -i.bak -e 's/,P1M,/,monthly,/' $ppdir/catalog.csv
         """
+        # when many data catalog jobs run simultaneously, they can fail
+        # this is not a good solution here
+        execution retry delays = PT5M, PT10M, PT15M
         [[[environment]]]
           ppdir = {{ PP_DIR }}