Skip to content

Releases: vkey/scrapper

v0.17.2

05 Nov 16:41
Compare
Choose a tag to compare

[v0.17.2] - 2024-11-05

Changed

  • Implemented conditional caching: results are now saved to disk only if caching is enabled, optimizing storage and performance.

Removed

  • Reverted resource and file type blocking functionality (block_types and block_extensions in BrowserQueryParams) due to performance concerns impacting scrapper efficiency.

Full Changelog: v0.17.1...v0.17.2

v0.17.1

11 Oct 14:50
Compare
Choose a tag to compare

[v0.17.1] - 2024-10-11

Added

  • Added support for the status_code field in the AnyPage model to capture the HTTP status of the page.
  • Introduced stealth_scripts and user_pre_scripts parameters to enable custom scripts for stealth mode and pre-page-load actions.
  • Updated the use_stealth_mode function to allow selective loading of scripts.
  • Added stealth.min.js to the app/scripts directory. This script was generated using npx extract-stealth-evasions based on the Puppeteer Extra Stealth Evasions repository (link).

Changed

  • Enhanced the page_processing function to return the HTTP status code.
  • Improved validation for custom scripts in the CommonQueryParams class.

Full Changelog: v0.17.0...v0.17.1

v0.17.0

10 Oct 11:30
bb4250a
Compare
Choose a tag to compare
Update README.md