github binux/pyspider v0.3.5

latest releases: v0.3.10, v0.3.9, v0.3.8...
8 years ago
  • New parameter: auto_recrawl - auto restart task every age.
  • New parameter: js_viewport_width/js_viewport_height to set viewport size for phantomjs engine.
  • New command line option to set different message queue backends with URI scheme.
  • New task level storage mechanism: self.save
  • New redis taskdb
  • New redis message queue.
  • New high level message queue interface kombu.
  • Fix bugs related to mongodb (keyword missing if not set).
  • Fix phantomjs not work in all mode.
  • Fix a potential deadlock in processor send_message.
  • Default log level of scheduler is changed to INFO

Don't miss a new pyspider release

NewReleases is sending notifications on new releases.