Skip to content

Codecs are serializing strings type and other improvements

Compare
Choose a tag to compare
@sibiryakov sibiryakov released this 09 Feb 14:26
· 324 commits to master since this release

Thanks to @voith, a problem introduced with beginning of support of Python 3 when Frontera was supporting only keys and values stored as bytes in .meta fields is now solved. Many Scrapy middlewares weren't working or working incorrectly. This is still not tested properly, so please report any bugs.

Other improvements include:

  • batched states refresh in crawling strategy,
  • proper access to redirects in Scrapy converters,
  • more readable and simple OverusedBuffer implementation,
  • examples, tests and docs fixes.

Thank you all, for your contributions!