github apify/crawlee v0.15.1

latest releases: v3.9.2, v3.9.1, v3.9.0...
4 years ago
  • BREAKING CHANGE Removed support for Web Driver (Selenium) since no further updates are planned.
    If you wish to continue using Web Driver, please stay on Apify SDK version ^0.14.15
  • BREAKING CHANGE: Dataset.getData() throws an error if user provides an unsupported option
    when using local disk storage.
  • DEPRECATED: options.userData of Apify.utils.enqueueLinks() is deprecated.
    Use options.transformRequestFunction instead.
  • Improve logging of memory overload errors.
  • Improve error message in Apify.call().
  • Fix multiple log lines appearing when a crawler was about to finish.
  • Add Apify.utils.puppeteer.enqueueLinksByClickingElements() function which enables you
    to add requests to the queue from pure JavaScript navigations, form submissions etc.
  • Add Apify.utils.puppeteer.infiniteScroll() function which helps you with scrolling to the bottom
    of websites that auto-load new content.
  • The RequestQueue.handledCount() function has been resurrected from deprecation,
    in order to have compatible interface with RequestList.
  • Add useExtendedUniqueKey option to Request constructor to include method and payload
    in the Request's computed uniqueKey.
  • Updated Puppeteer to 1.18.1
  • Updated apify-client to 0.5.22

Don't miss a new crawlee release

NewReleases is sending notifications on new releases.