how to handle timeout error

[zy783282949]

Which package is this bug report for? If unsure which one to select, leave blank

None

Issue description

I am using CheerioCrawler. When I run the crawler.run() method for a while, an error occurs:
Handling request failure of https://xxx(ZNGIMiMhlwKFihT) timed out after 300 seconds.
I hope to drop this data and continue execution instead of exiting from the main process.

Code sample

The pseudo code is as follows: Two functions will be executed simultaneously in the main function, one is the enqueueProcess function, which continuously fetches data from redis and calls the crawler.addRequest() method to add it to the queue, and the other is the crawler.run() method

async function enqueueProcess(){
while (true){
crawler.addRequest("xxx")
}
}
async function main(){
const crawler = new CheerioCrawler();
enququeProcess();
crawler.run();
}

Package version

├── [email protected] ├── [email protected] ├── [email protected] ├── [email protected] └── [email protected]

Node.js version

v20.16.0

Operating system

centos8

Apify platform

• Tick me if you encountered this issue on the Apify platform

I have tested this on the next release

No response

Other context

No response

[B4nan]

The pseudo code is as follows

Please share the actual code (simplified, but not pseudocode), as well as the exact error message including a stack trace. Details matter.

[email protected]

You should always upgrade first before reporting anything, as you might be facing something that is already fixed.