Releases: vkey/scrapper
Releases · vkey/scrapper
v0.17.2
[v0.17.2] - 2024-11-05
Changed
- Implemented conditional caching: results are now saved to disk only if caching is enabled, optimizing storage and performance.
Removed
- Reverted resource and file type blocking functionality (
block_types
andblock_extensions
inBrowserQueryParams
) due to performance concerns impacting scrapper efficiency.
Full Changelog: v0.17.1...v0.17.2
v0.17.1
[v0.17.1] - 2024-10-11
Added
- Added support for the
status_code
field in theAnyPage
model to capture the HTTP status of the page. - Introduced
stealth_scripts
anduser_pre_scripts
parameters to enable custom scripts for stealth mode and pre-page-load actions. - Updated the
use_stealth_mode
function to allow selective loading of scripts. - Added
stealth.min.js
to theapp/scripts
directory. This script was generated usingnpx extract-stealth-evasions
based on the Puppeteer Extra Stealth Evasions repository (link).
Changed
- Enhanced the
page_processing
function to return the HTTP status code. - Improved validation for custom scripts in the
CommonQueryParams
class.
Full Changelog: v0.17.0...v0.17.1