Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ensure ADIOS2 Variable Based Encoding Can be Read #434

Open
ax3l opened this issue Feb 13, 2025 · 1 comment
Open

Ensure ADIOS2 Variable Based Encoding Can be Read #434

ax3l opened this issue Feb 13, 2025 · 1 comment
Labels

Comments

@ax3l
Copy link
Member

ax3l commented Feb 13, 2025

We need to check if variableBased encoding works for ADIOS2 BP5 files in openPMD-viewer.

Orthogonal approaches, I would say we should support both:

Docs:
https://openpmd-api.readthedocs.io/en/0.16.1/backends/adios2.html

cc @ax3l @guj @franzpoeschel

@ax3l ax3l added the feature label Feb 13, 2025
@franzpoeschel
Copy link
Contributor

#1706 is nearly feature-complete, so this could be tested already. Currently missing is the support for modifiable attributes which will come as a follow-up PR (this requires pre-parsing the ADIOS2 file in adios2::Mode::Read instead of adios2::Mode::ReadRandomAccess and is hence not entirely trivial). Consequences:

  1. Information such as /data/time will currently be useless.
  2. Data Series with different contents per Iteration will not be supported since we would have to resolve file steps to variable steps. Could maybe be done once preparsing is implemented, but it's not a priority.

Add a generator-like expression to iterate over all particles/fields, as in the streaming read mode. This needs new user-facing APIs in openPMD-viewer.

I didn't expose it for Python yet since the final API is still up for discussion, but note that on the current dev and especially with #1706, series.iterations, series.writeIterations() and series.readIterations() can all be replaced by the unified API series.snapshots().

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants