The highlight of this release is the long-awaited Python 3 support.
The new scrapy requirement is version 1.0 or higher.
Python 2.6 is no longer supported by scrapyd.
Some unused sqlite utilities are now deprecated
and will be removed from a later scrapyd release.
Instantiating them or subclassing from them
will trigger a deprecation warning.
These are located under scrapyd.sqlite:
- SqliteDict
- SqlitePickleDict
- SqlitePriorityQueue
- PickleSqlitePriorityQueue
Added
- Include run's PID in listjobs webservice.
- Include full tracebacks from scrapy when failing to get spider list.
This will lead to more noisy webservice output
but will make debugging deployment problems much easier. - Include start/finish time in daemon's joblist page
- Twisted 16 compatibility
- Python 3 compatibility
- Make console script executable
- Project version argument in the schedule webservice
- Configuration option for website root class
- Optional jobid argument to schedule webservice
- Contribution documentation
- Daemon status webservice
Removed
- scrapyd's bind_address now defaults to 127.0.0.1 instead of 0.0.0.0
to listen only for connection from the local host - scrapy < 1.0 compatibility
- python < 2.7 compatibility
Fixed
- Poller race condition for concurrently accessed queues