Python Embedding Issue in MET Ensemble Stat #2868
-
|
Hi, everyone! I am encountering an issue when using Python embedding with the MET ensemble stat tool and would like to seek your assistance in resolving it. To provide some context, I have been attempting to use the Python embedding feature within the ensemble stat tool, but I am running into difficulties. I have attached the following files to help clarify the issue: In addition to the files, I have also listed the exact command I used to call the ensemble stat tool, along with the error message I received. python-embeding.zip Any advice would be highly appreciated! Thank you very much! Best, |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments 8 replies
-
|
HI @Daisy792. Thank you for describing the problem and sending some files. It looks like your fcst_list.ascii file is not formatted correctly. The ens_file_list is an ASCII file containing a space-separated list of ensemble member file names. Please try changing your file to be a space-separated list of ensemble member file names. For example: etc. and try rerunning. Please let us know how it goes. |
Beta Was this translation helpful? Give feedback.
-
|
@jprestop and @Daisy792, let me clarify that this this should be a white-space separated list. That means you can use any combination of spaces and/or newlines. So you could put each file on it's own line: |
Beta Was this translation helpful? Give feedback.
-
|
Thank you for your explanation! Since the configuration file needs to be set as follows: |
Beta Was this translation helpful? Give feedback.
-
|
Hi @Daisy792. Thank you for clarifying that you would like to pass additional arguments to the embedded Python script. From reviewing the User's Guide Python Embedding section on Special Case for Ensemble-Stat, Series-Analysis, and MTD, it looks like your file is set up correctly. One thing I noticed is that in your EnsembleStatConfig_Mean file you have the following set: I see in the User's Guide:
Could you please try changing "embed_fuxi.py" to include its full path and then rerun? If that is not successful, please let me know, and I'll ask someone on our team who has more Python embedding experience to help. Thank you. |
Beta Was this translation helpful? Give feedback.
-
|
Hi, @jprestop~
in EnsembleStatConfig_mean and the result was still the same:
Thank you very much for any possible solution to solve this problem! |
Beta Was this translation helpful? Give feedback.
-
|
Hi @Daisy792, @jprestop asked me to take a look at the error you are getting. First, I see that the link in @jprestop last reply may have been incorrect. Here is the user guide section that I think was intended to be shared: It sounds like you're familiar with this section though, because you say:
Putting it all together, this is the relevant section from the user guide: Using @JohnHalleyGotway suggestion from above: You can create the file like this: You will need to replace Your Python script will be used 4 times in this example, 1 for each file in the file list. Your Python script will receive each element in the This means that your Python script is actually only receiving a single command line argument, but this argument contains three "comma separated elements" that you must be parse inside your Python script. Here is one way you could do that: Give this a try and let us know how it goes! |
Beta Was this translation helpful? Give feedback.
-
|
Hi, @DanielAdriaansen~ Thank you for your advice.
The exact command was:
and got the result:
l also tried to use the former fcst_list:
with new python-embedding file but still failed:
|
Beta Was this translation helpful? Give feedback.
-
|
@Daisy792, great news, I have a nice simple solution that doesn't require a bugfix or anything. Your discussion points out that we really need to update the MET documentation about how "file_list" files work. This is all baked into the logic of the METplus wrappers, so I haven't thought about this detail in a while. Please prefix your file list file with the keyword But adding And that should circumvent that runtime error you're getting with Python embedding in Ensemble-Stat. Please do let us know if that solves the problem for you! |
Beta Was this translation helpful? Give feedback.
-
|
Hi, @JohnHalleyGotway , l'm sorry for the late response! l have tried to add "file_list" at the beginning of fcst_list.ascii, so fcst_list.ascii is like:
and use the command line like:
would get the result :
After l changed line 83 in EnsembleStatConfig_mean to:
it can run successfully!!
Thank you very much for your advice and that indeed solved my problem! Wish you all the best, |
Beta Was this translation helpful? Give feedback.
-
|
@Daisy792 I'm glad that did the trick. I also wanted to point out that we took this opportunity to add more details to the MET User's Guide about the use of file lists. Please see this new ASCII File Lists section, and we've updated all the usage statements for tools that use them (e.g. Ensemble-Stat Usage) to link to that new 'ASCII File Lists' section. These documentation changes are in the |
Beta Was this translation helpful? Give feedback.
@Daisy792, great news, I have a nice simple solution that doesn't require a bugfix or anything. Your discussion points out that we really need to update the MET documentation about how "file_list" files work. This is all baked into the logic of the METplus wrappers, so I haven't thought about this detail in a while.
Please prefix your file list file with the keyword
file_list. I set up a test using canned sample data as input to Ensemble-Stat and ran it without thefile_listprefix to produce this runtime error:But adding
file_listas the first line of that file enabled it to run witho…