apify/crawlee-python v1.0.0 on GitHub

1.0.0 (2025-09-29)

Add utility for load and parse Sitemap and SitemapRequestLoader (#1169) (66599f8) by @Mantisus
Add periodic status logging and status_message_callback parameter for customization (#1265) (b992fb2) by @Mantisus
Add crawlee-cli option to skip project installation (#1294) (4d5aef0) by @Pijukatel
Improve Crawlee CLI help text (#1297) (afbe10f) by @Pijukatel
Add basic OpenTelemetry instrumentation (#1255) (a92d8b3) by @Pijukatel
Add ImpitHttpClient http-client client using the impit library (#1151) (0d0d268) by @Mantisus
Prevent overloading system memory when running locally (#1270) (30de3bd) by @janbuchar
Expose PlaywrightPersistentBrowser class (#1314) (b5fa955) by @Mantisus
Add impit option for Crawlee CLI (#1312) (508d7ce) by @Mantisus
Persist RequestList state (#1274) (cc68014) by @janbuchar
Persist DefaultRenderingTypePredictor state (#1340) (fad4c25) by @Mantisus
Persist the SitemapRequestLoader state (#1347) (27ef9ad) by @Mantisus
Add support for NDU storages (#1401) (5dbd212) by @vdusek
Add RQ id, name, alias args to add_requests and enqueue_links methods (#1413) (1cae2bc) by @Mantisus
Add SqlStorageClient based on sqlalchemy v2+ (#1339) (07c75a0) by @Mantisus

Fix memory estimation not working on MacOS (#1330) (ab020eb) by @Pijukatel
Fix retry count to not count the original request (#1328) (74fa1d9) by @Pijukatel
[breaking] Remove unused "stats" field from RequestQueueMetadata (#1331) (0a63bef) by @vdusek
Ignore unknown parameters passed in cookies (#1336) (50d3ef7) by @Mantisus
Fix timeout for stream method in ImpitHttpClient (#1352) (54b693b) by @Mantisus
Include reason in the session rotation warning logs (#1363) (d6d7a45) by @vdusek
Improve crawler statistics logging (#1364) (1eb6da5) by @vdusek
Do not add a request that is already in progress to MemoryRequestQueueClient (#1384) (3af326c) by @Mantisus
Save RequestQueueState for FileSystemRequestQueueClient in default KVS (#1411) (6ee60a0) by @Mantisus
Set default desired concurrency for non-browser crawlers to 10 (#1419) (1cc9401) by @vdusek

[breaking] Introduce new storage client system (#1194) (de1c03f) by @vdusek
[breaking] Split BrowserType literal into two different literals based on context (#1070) (72b5698) by @Pijukatel
[breaking] Change method HttpResponse.read from sync to async (#1296) (83fa8a4) by @Mantisus
[breaking] Replace HttpxHttpClient with ImpitHttpClient as default HTTP client (#1307) (c803a97) by @Mantisus
[breaking] Change Dataset unwind parameter to accept list of strings (#1357) (862a203) by @vdusek
[breaking] Remove Request.id field (#1366) (32f3580) by @Pijukatel
[breaking] Refactor storage creation and caching, configuration and services (#1386) (04649bd) by @Pijukatel