-
Notifications
You must be signed in to change notification settings - Fork 55
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
DFSU.read() very slow on AMD CPU or linux #709
Comments
@JesperGr - this most be related to MIKE Core ... |
Is there anything we can do about it? It may be related to what you do in the read function. Is it using pandas in the underlying code? I know that pandas code is slower on AMD platforms. |
@bhlevca could you try with a profiler - I hear Scalene is great https://github.com/plasma-umass/scalene :-) |
I guess that I need to use the mikeio source files to do useful profiling |
You get those when you install MIKE IO (pure python) |
Usually, When I debug, I point Pythonpath to the git folder |
Describe the bug
A clear and concise description of what the bug is.
I am expecting some differences but not 30x.
There is something in the read algorithm that may be favoured by Intel CPU.
I have a code
The dfsu file is large ~ 52 GB.
The same read operation takes 17-18 sec on an Intel i7 CPU laptop running Windows 10 and 420 sec on a powerful AMD Ryzen 3950X desktop running Linux.
To Reproduce
Steps to reproduce the behavior:
Get a large DFSU file and use
read (x,y)
System information:
The text was updated successfully, but these errors were encountered: