Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

increase aggresiveness for file downloads #39

Open
kmike opened this issue Apr 19, 2016 · 1 comment
Open

increase aggresiveness for file downloads #39

kmike opened this issue Apr 19, 2016 · 1 comment

Comments

@kmike
Copy link
Contributor

kmike commented Apr 19, 2016

I think it makes sense to make file downloading more aggressive. Browsers allow ~6 parallel connections to the same server; it should be fine to download multiple static files in parallel from the same server. Currently we're throttling it to 1 parallel download on average using autothrottle algorithm.

Autothrottle doesn't make much sense for static files anyways - file size can vary a lot; it doesn't make sense to adjust download delay for 10Kb JPEG file based on that we spent 1 minute downloading 50MB pdf file.

@lopuhin
Copy link
Contributor

lopuhin commented Apr 19, 2016

Yeah, i didn't realize the different size problem. Right now they just go to different slots.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants