Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LCP service is broken #515

Closed
nwagenbrenner opened this issue Mar 19, 2024 · 6 comments
Closed

LCP service is broken #515

nwagenbrenner opened this issue Mar 19, 2024 · 6 comments

Comments

@nwagenbrenner
Copy link
Member

No description provided.

@nwagenbrenner
Copy link
Member Author

The service is just really slow right now. Increasing LCP_MAX_DOWNLOAD_TRIES from 40 to 200 just worked for me.

@nwagenbrenner nwagenbrenner modified the milestones: Unplanned, 3.10.1 Apr 4, 2024
@rdwadhwani0220
Copy link

Hey Natalie, I modified landfireclient.cpp and increased LCP_MAX_DOWNLOAD_TRIES to 200 but it is still not working for us and I am unable to fetch the LCP elevation files.

@nwagenbrenner
Copy link
Member Author

@rdwadhwani0220 Thanks for the update. Other users are reporting much longer download times as well. One user reported that LCP_MAX_DOWNLOAD_TRIES set to 300 was working for them one day and the next day they had to increase to 2000. We will file a ticket with the LANDFIRE helpdesk to see what is going on and if anything can be done.

@rdwadhwani0220
Copy link

@nwagenbrenner Sure, update me when you receive any solution. However, I increased to 5000 also but it failed to work for our case.

@nwagenbrenner
Copy link
Member Author

The response from LANDFIRE:

In the last several months, LFPS has been going through many changes. We are working to bolster and enhance LFPS, this has required some large changes in the background. We are aware of the increased processing time and are actively investigating the issue. Thank you for providing the details about your job, we hope to have the increased processing time issue resolved in the near future and we apologize for the inconvenience.

Maybe a good time to work on #459.

latwood added a commit that referenced this issue May 28, 2024
…o 300 in a partial attempt to make lcp downloads more likely to finish

This will only be temporarily for while the LCP download service remains as crazy slow as it has been for the last two months. They're working on it, so hopefully it doesn't go on for too much longer.

But as it stands, this is just a partial fix because sometimes the lcp downloads have been working in 200 to 300 attempts, and sometimes up to 1000 attempts, and sometimes 5000 attempts isn't enough. For reference, the default 40 attempts seems to take about 2 minutes, 100 attempts 5 minutes, 200 attempts 8 minutes, 300 attempts about 10 minutes. I tried 2000 attempts and then 5000 attempts on a really bad time period, and it took 1.5 hrs and up to 2.5 hrs or so respectively, way longer than any of the more computationally expensive WindNinja runs.

for issue #515
@nwagenbrenner
Copy link
Member Author

Closing this since the issue is out of our hands. All we can do is look to host our own service and that is captured in #459.

@nwagenbrenner nwagenbrenner modified the milestones: 3.10.1, 3.11.0 Jun 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants