Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

phdf5 output is ... slo0ooo0oowwwwWww #16

Open
gnwong opened this issue Jun 4, 2020 · 0 comments
Open

phdf5 output is ... slo0ooo0oowwwwWww #16

gnwong opened this issue Jun 4, 2020 · 0 comments
Labels

Comments

@gnwong
Copy link
Contributor

gnwong commented Jun 4, 2020

I've opted for the questionably severe "bug" label given how much this behavior impacts runtime.

In particular, it seems like the default way hdf5 writes files from a large (~256) number of nodes on stampede2 is far slower than it should be. Presumably, this problem scales with the number of nodes, and this is particularly concerning when trying to run large simulations (e.g., 448x224x224) in a reasonable amount of wall time.

In addition to optimizing the mpi write on stampede2, it seems like writing smaller dump files (not outputting gamma or diagnostics like extras/fixup, extras/divB, extras/fail) should speed things up as well.

@gnwong gnwong added the bug label Jun 4, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant