dlt-hub/dlt 0.4.6

on GitHub

Core Library

• feat(airflow): expose the Airflow runner method to create custom DAGs by @IlyaFaer in #1014
• removes sql alchemy dependency and port parts of URL class by @rudolfix in #1028
• Parallelize decorator - run many regular generators in parallel by @steinitzu in #965
• Add main entry point to support calling dlt as python module by @sultaniman in #1023

Library Bugfixes

• fixes naive datetime bug in incremental by @rudolfix in #1020
• Import missing pyarrow compute for transforms on arrowitems by @sh-rp in #1010
• delete normalized package in case it already existed by @sh-rp in #1012
• fix(core): validation error with TTableHintTemplate by @IlyaFaer in #1039
• adds test case where payload data contains PUA unicode characters by @willi-mueller in #1053
• fix add_limit behavior in edge cases by @sh-rp in #1052
• adds row_order to Incremental - automatically stop taking data when out of range by @rudolfix in #1041
• Fix to serialize load metrics as list instead of a dictionary by @sultaniman in #1051
• fix import schema workflow by @sh-rp in #1013
• rollback all changes to live schemas when extraction fails by @sh-rp in #1013

Docs

• Fix zendesk example test by @VioletM in #1027
• Edit arrow-pandas.md and fix a typo by @Bl3f in #1001
• Added info about file compression to filesystem docs by @dat-a-man in #975
• Update "create destination" docs with new file layouts by @steinitzu in #1032
• Docs update on how to set query limits. by @dat-a-man in #973
• Docs/Updated for slack alerts. by @dat-a-man in #1042

Verified Sources

• scrape web sites with spiders and Scrapy and send data to dlt @sultaniman dlt-hub/verified-sources#332
• sql_database recoginizes end_value and row_order to return rows in range and optionally ordered. backfill and proper Airflow intervals support @rudolfix dlt-hub/verified-sources#388

New Contributors

• @Bl3f made their first contribution in #1001

Full Changelog: 0.4.5...0.4.6