Rate Limit Issue 10KTPM-200RPM

[kryptobaseddev]

Looking to make some adjustments to create a wait loop to check based on Rate Limit for the specific models. I have been getting an issue when trying to run and hit the limits.

If we can incorporate a way to put a wait/pause loop type check for this type of error so the notebook can continue without failing when hitting the limit.

I will be testing some options but wanted to start this thread to get others input.

[ipropheti]

I tried forking and playing around with this. But I had a few options - ratelimit works, also chunking the request certainly helps.