dlt-hub/dlt 0.3.21

on GitHub

What's Changed

• athena iceberg by @sh-rp in #659
  Use new table hint table format to store selected Athena tables in iceberg format (https://dlthub.com/docs/dlt-ecosystem/destinations/athena#iceberg-data-tables)

• Pyarrow direct loading by @steinitzu and @tomsej in #679
  Allows to pass Arrow tables and Panda frames to the run method and load them directly (via parquet) without data copy (https://dlthub.com/docs/dlt-ecosystem/verified-sources/arrow-pandas) which should result in immense speedups in many loading cases

• Features/dbt cloud by @AstrakhantsevaAA in #694
  Run dbt jobs in the cloud (https://dlthub.com/docs/dlt-ecosystem/transformations/dbt/dbt_cloud)

• enables duckdb 0.9.1 and improves motherduck docs by @rudolfix in #695
  Please also read Motherduck updated documentation (https://dlthub.com/docs/dlt-ecosystem/destinations/motherduck) - you may want to reduce load parallelism if you are on weak internet connection

• allows to provide custom implementation of DltSource to the source decorator by @rudolfix in #687

Bugfixes

• change source schema handling and normalizer root_key propagation. fixes various problems where merge and replace write dispositions were subsequently used in the same pipeline by @sh-rp in #686
• fixes bug in drop command by @sh-rp in #693

Docs

• Refactor documentation structure by @burnash in #672

Full Changelog: 0.3.19...0.3.21