Produces a 67 second delay every 24 requests.

[fluxtransistor]

I'm pulling every hot 100 chart into JSON format. I have set the scraper to have a timeout of 4 seconds and a max-retries of 1, but somehow it still produces a 67 second delay once every 24 requests. This adds a significant amount of time to my aggregator's runtime.

[fluxtransistor]

So I have determined that it's not exactly 24 requests, but it varies thereabouts. Interestingly, the delay time is always 67 seconds.

[guoguo12]

Thanks for reporting. Haven't had time to look into this, but the delay probably comes from Billboard (they send a Retry-After header, which this library respects), in which case, there's nothing to be done here.