Does the PCPCombine wrapper support tag replacement for init with python embedding?

[jvigh]

Dear METplus Experts,

I am trying to develop a new use case for SWPC in which the data are purportedly nowcasts.

Here are some of the relevant configuration settings:
LOOP_BY = INIT
FCST_PCP_COMBINE_DERIVE_LOOKBACK = 24H
FCST_PCP_COMBINE_INPUT_DATATYPE = PYTHON_NUMPY
FCST_PCP_COMBINE_INPUT_NAMES = {PROJECT_BASE}/scripts/python/read_WAMIPE_from_NOMADS.py {INPUT_BASE}/WAMIPE/{init?fmt=%Y}/{init?fmt=%m}/{init?fmt=%d}/WAMIPE/wrs.t{valid?fmt=%H}z.ipe05.{valid?fmt=%Y%m%d}{valid?fmt=%H%M%S}.nc NmF2 {init?fmt=%Y%m%d%H%M%S} {init?fmt=%Y%m%d_%H%M%S}

I am getting the following error:

In run_pcpcombine:
realtime_config = realtime_config

Traceback (most recent call last):
File "/swpc-rt/SWPC-Realtime-Evaluation/ush/run_swpc-rt_metplus_subsystem.py", line 1680, in
main()
File "/swpc-rt/SWPC-Realtime-Evaluation/ush/run_swpc-rt_metplus_subsystem.py", line 1618, in main
run_pcpcombine(realtime_config)
File "/swpc-rt/SWPC-Realtime-Evaluation/ush/run_swpc-rt_metplus_subsystem.py", line 556, in run_pcpcombine
PCPCombineWrapper(realtime_config).run_all_times()
File "/usr/local/lib/python3.10/site-packages/metplus-5.1.0-py3.10.egg/metplus/wrappers/command_builder.py", line 1324, in run_all_times
return loop_over_times_and_call(self.config, self, custom=custom)
File "/usr/local/lib/python3.10/site-packages/metplus-5.1.0-py3.10.egg/metplus/util/time_looping.py", line 157, in loop_over_times_and_call
process.run_at_time(time_input)
File "/usr/local/lib/python3.10/site-packages/metplus-5.1.0-py3.10.egg/metplus/wrappers/reformat_gridded_wrapper.py", line 101, in run_at_time
self.run_at_time_once(time_info, var_list, to_run)
File "/usr/local/lib/python3.10/site-packages/metplus-5.1.0-py3.10.egg/metplus/wrappers/pcp_combine_wrapper.py", line 235, in run_at_time_once
self.run_at_time_one_field(time_info, var_info, data_src)
File "/usr/local/lib/python3.10/site-packages/metplus-5.1.0-py3.10.egg/metplus/wrappers/pcp_combine_wrapper.py", line 263, in run_at_time_one_field
can_run = self.setup_derive_method(time_info, lookback_seconds,
File "/usr/local/lib/python3.10/site-packages/metplus-5.1.0-py3.10.egg/metplus/wrappers/pcp_combine_wrapper.py", line 542, in setup_derive_method
files_found = self.get_accumulation(time_info,
File "/usr/local/lib/python3.10/site-packages/metplus-5.1.0-py3.10.egg/metplus/wrappers/pcp_combine_wrapper.py", line 714, in get_accumulation
field_info = self.get_field_string(
File "/usr/local/lib/python3.10/site-packages/metplus-5.1.0-py3.10.egg/metplus/wrappers/pcp_combine_wrapper.py", line 821, in get_field_string
field_info = do_string_sub(field_info, **time_info)
File "/usr/local/lib/python3.10/site-packages/metplus-5.1.0-py3.10.egg/metplus/util/string_template_substitution.py", line 356, in do_string_sub
match_result = find_and_replace_tags_in_template(match_list,
File "/usr/local/lib/python3.10/site-packages/metplus-5.1.0-py3.10.egg/metplus/util/string_template_substitution.py", line 398, in find_and_replace_tags_in_template
raise TypeError("The key " + split_string[0] +
TypeError: The key init was not passed to do_string_sub for template: 'name="/swpc-rt/SWPC-Realtime-Evaluation/scripts/python/read_WAMIPE_from_NOMADS.py /swpc-rt/input_data_realtime/WAMIPE/{init?fmt=%Y}/{init?fmt=%m}/{init?fmt=%d}/WAMIPE/wrs.t{init?fmt=%H}z.ipe05.{valid?fmt=%Y%m%d}{valid?fmt=%H%M%S}.nc NmF2 {init?fmt=%Y%m%d%H%M%S} {valid?fmt=%Y%m%d_%H%M%S}";': {'valid': datetime.datetime(2023, 10, 31, 3, 5), 'lead': 0}

It seems as if the 'init' tag is not being passed internally. If I change it to 'valid', then it works. Does the PCPCombine wrapper support tage replacement for init with python embedding?

Thanks,
Jonathan & Tina

[georgemccabe]

Hi Jonathan and Tina,

Please try setting FCST_PCP_COMBINE_CONSTANT_INIT = True and rerun. Typically when running PCPCombine wrapper using the derive or add methods, the wrapper starts with the valid time and steps backwards to build an accumulation, so there is no notion of a single initialization time to use.