Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for binary files #125

Open
EdwardSafford-NOAA opened this issue May 5, 2022 · 1 comment
Open

Support for binary files #125

EdwardSafford-NOAA opened this issue May 5, 2022 · 1 comment

Comments

@EdwardSafford-NOAA
Copy link
Contributor

@CoryMartin-NOAA this isn't so much an issue (yet) as it is a question. The DA monitors, as currently configured, extract and store data in binary files, and the files are then used to plot data over specific ranges, usually out to 30 days. So I think I'll need some python utilities to read and write to binary files in order to make those time-series plots.

So if I put together some simple read/write python utilities for binary files where would they best be located? Here in PyGSI, emcpy, or someplace else?

Related information -- I know that eventually EMC is to acquire a cloud based database. I checked with Eric Rodgers and he reports that the specifics on that database are not yet known, and that it will be at least a year before it is implemented. So, in the mean time, the monitors will need to continue to use a file-based storage mechanism. Thoughts?

@CoryMartin-NOAA
Copy link
Contributor

@EdwardSafford-NOAA I would say since they are GSI-centric (or at least legacy/current ops) then putting these tools in PyGSI makes sense to me. Eventually, with JEDI, we would probably want to use netCDF or some other format besides raw binary to store time series data and other intermediate computations (averaging, etc.) (the exact implementation of this has been discussed but no solution yet) , but no sense reinventing the wheel at this point.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants