Crawl with different devices and from countries

[abhisheksurve45]

Hi,

I have a usecase to

1. Crawl with different devices (desktop, mobile, tablet, smart tv)
2. Crawl from different countries (US, UK, etc)

I'm using crawlee with puppeteer crawler.

Right now to achieve 1, I'm setting different UA and viewport on puppeteer page object based on device. Would that be enough to mimic the behavior or few more tweaks are required? (such as fingerprint etc)

For point 2, I'm not sure how to go ahead with it, would just setting geolocation in puppeteer work? https://pptr.dev/api/puppeteer.page.setgeolocation/ ... or I'll have to use proxies present on the location.

Thanks.

[abhisheksurve45]

Afaik just the geo API wont be enough, some websites also do track the IP address.

[abhisheksurve45]

Just UA and viewport wont work, browser fingerprint would be required as per used device and UA/viewport config.