pypi Scrapy 1.5.0

latest releases: 2.11.1, 1.8.4, 2.11.0...
6 years ago

This release brings small new features and improvements across the codebase.
Some highlights:

  • Google Cloud Storage is supported in FilesPipeline and ImagesPipeline.
  • Crawling with proxy servers becomes more efficient, as connections to proxies can be reused now.
  • Warnings, exception and logging messages are improved to make debugging easier.
  • scrapy parse command now allows to set custom request meta via --meta argument.
  • Compatibility with Python 3.6, PyPy and PyPy3 is improved; PyPy and PyPy3 are now supported officially, by running tests on CI.
  • Better default handling of HTTP 308, 522 and 524 status codes.
  • Documentation is improved, as usual.

Full changelog is in the docs.

Don't miss a new Scrapy release

NewReleases is sending notifications on new releases.