v3.8.0

3.8.0 (2024-02-21)

Bug Fixes

• createRequests works correctly with exclude (and nothing else) (#2321) (048db09)
• puppeteer: add 'process' to the browser bound methods (#2329) (2750ba6)
• puppeteer: replace page.waitForTimeout() with sleep() (52d7219), closes #2335
• puppeteer: support puppeteer@v22 (#2337) (3cc360a)

Features

• KeyValueStore.recordExists() (#2339) (8507a65)
• accessing crawler state, key-value store and named datasets via crawling context (#2283) (58dd5fc)
• adaptive playwright crawler (#2316) (8e4218a)
• add Sitemap.tryCommonNames to check well known sitemap locations (#2311) (85589f1), closes #2307
• core: add userAgent parameter to RobotsFile.isAllowed() + RobotsFile.from() helper (#2338) (343c159)
• Support plain-text sitemap files (sitemap.txt) (#2315) (0bee7da)