3.1.0 (2022-10-13)
Bug Fixes
- add overload for
KeyValueStore.getValue
with defaultValue (#1541) (e3cb509) - add retry attempts to methods in CLI (#1588) (9142e59)
- allow
label
inenqueueLinksByClickingElements
options (#1525) (18b7c25) - basic-crawler: handle
request.noRetry
aftererrorHandler
(#1542) (2a2040e) - build storage classes by using
this
instead of the class (#1596) (2b14eb7) - correct some typing exports (#1527) (4a136e5)
- do not hide stack trace of (retried) Type/Syntax/ReferenceErrors (469b4b5)
- enqueueLinks: ensure the enqueue strategy is respected alongside user patterns (#1509) (2b0eeed)
- enqueueLinks: prevent useless request creations when filtering by user patterns (#1510) (cb8fe36)
- export
Cookie
fromcrawlee
metapackage (7b02ceb) - handle redirect cookies (#1521) (2f7fc7c)
- http-crawler: do not hang on POST without payload (#1546) (8c87390)
- remove undeclared dependency on core package from puppeteer utils (827ae60)
- support TypeScript 4.8 (#1507) (4c3a504)
- wait for persist state listeners to run when event manager closes (#1481) (aa550ed)
Features
- add
Dataset.exportToCSV
andDataset.exportToJSON
- add
Dataset.getData()
shortcut (522ed6e) - add
utils.downloadListOfUrls
to crawlee metapackage (7b33b0a) - add
utils.parseOpenGraph()
(#1555) (059f85e) - add
utils.playwright.compileScript
(#1559) (2e14162) - add
utils.playwright.infiniteScroll
(#1543) (60c8289), closes #1528 - add
utils.playwright.saveSnapshot
(#1544) (a4ceef0) - add global
useState
helper (#1551) (2b03177) - allow disabling storage persistence (#1539) (f65e3c6)
- bump puppeteer support to 17.x (#1519) (b97a852)
- core: add
forefront
option toenqueueLinks
helper (f8755b6), closes #1595 - don't close page before calling errorHandler (#1548) (1c8cd82)
- enqueue links by clicking for Playwright (#1545) (3d25ade)
- error tracker (#1467) (6bfe1ce)
- make the CLI download directly from GitHub (#1540) (3ff398a)
- router: add userdata generic to addHandler (#1547) (19cdf13)
- use JSON5 for
INPUT.json
to support comments (#1538) (09133ff)