Core Library
- enables google drive filesystem for sources and destinations (second one experimental, google drive listings are only eventually consistent!) by @IlyaFaer in #932
- creates parallel Airflow DAGs in airflow helper to allow many resources to be executed at once @IlyaFaer in #966
- 855 create bigquery adapter for dlt resources: easily configure partitions, clustering, data retention etc. by @Pipboyguy in #952 and https://dlthub.com/docs/dlt-ecosystem/destinations/bigquery#bigquery-adapter
- Use BIGNUMERIC for large decimals in bigquery by @steinitzu in #984
- Normalize keys for Google secrets config provider by @sultaniman in #963
- does not lowercase postgres and redshift database names by @rudolfix in #990
- Introduce
hard_deleteanddedup_sortcolumns hint formergeby @jorritsandbrink in #960 and https://dlthub.com/docs/general-usage/incremental-loading#delete-records - adjustment of pua start in typed json encoding, pass through on decoding errors by @rudolfix in #974
- creates isolated parallel Airflow DAGs in airflow helper to execute resources parallel in isolated pipelines @IlyaFaer in #979
- Fix annotation processing and rebuilding, mark dataclass as complex by @sultaniman in #980
- allows async functions to be decorated with dlt.source by @rudolfix in #985
- allows right pipe operator to feed simple lists into a transformer @rudolfix in #985
- allows pendulum datetime as incremental cursor when loading arrow tables @rudolfix in #985
- enables Python 3.12 (mind that not all extras have python 3.12 libraries!) @rudolfix in #985
Docs
- docs(filesystem): include Google Drive into filesystem tutorial by @IlyaFaer in #962
- Fix typos/grammar in tutorial docs by @taljaards in #972
- add blog post observability by @adrianbr in #989
- Update arrow-pandas.md by @snehangsude in #992
- Clarify info about GoodData in modelling tools article by @mhauzirek in #956
- Fix small typings in contributing guide by @VioletM in #993
- Docs/google sheets update by @dat-a-man in #976
- Added "Incremental Configuration" section to SQL Databases documentat… by @dat-a-man in #977
Verified Sources
- Bing Webmaster source by @willi-mueller
New Contributors
- @taljaards made their first contribution in #972
- @mhauzirek made their first contribution in #956
- @snehangsude made their first contribution in #992
- @VioletM made their first contribution in #993
Full Changelog: 0.4.4...0.4.5