dlt-hub/dlt 0.5.2

on GitHub

Core Library

• Add upsert merge strategy for Postgres and Snowflake, by @jorritsandbrink in #1466
• Add basic upsert support for delta table format in filesystem destination by @jorritsandbrink in #1600
• query tagging for snowflake by @rudolfix in #1582
• Support Open Source ClickHouse Deployments (MergeTree engine and more) by @Pipboyguy in #1496
• allows nested types in BigQuery via native autodetect_schema by @rudolfix in #1591
• Enable upsert merge strategy for more SQL destinations (Athena, BigQuery, Databricks, mssql) by @jorritsandbrink in #1628
• Fix/1512 fixes current.pipeline() access by @rudolfix in #1581
• feat: add config dataset_name_prefix to set custom staging dataset name by @donotpush in #1563
• fix: add airflow db reset for all tests by @donotpush in #1559
• Enable S3 compatible storage for delta table format by @jorritsandbrink in #1586
• feat/1495 rest_client: renames JSONResponsePaginator to JSONLinkPaginator by @willi-mueller in #1558
• Feat/1596 adds custom config providers + example of yaml config provider supporting profiles and jinja placeholders by @rudolfix in #1642
• Feat/1583 rest client session timeout configuration by @willi-mueller in #1590
• Add clarification for add_limit by @VioletM in #1594
• Fix/1606 fixes validator incremental step order to keep it always last in the pipe by @rudolfix in #1641
• Feat/1593 rest_client: allow setting of request kwargs by @willi-mueller in #1609
• prevent accidental wrapping of sources in resources when using adapters by @sh-rp in #1645
• Add empty source handling for delta table format on filesystem destination by @jorritsandbrink in #1617
• Surface original err msg from pydantic as extended_info on DataValidationError by @codingcyclist in #1569
• fix(dockerfile): remove extra spaces around equals sign in LABEL inst… by @thisisdope in #1573
• Qdrant uncommitted state restore and test by @steinitzu in #1545
• fix: suppress alembic logs for tests by @donotpush in #1578

Docs

• Document sql source reflection level and type adapter by @steinitzu in #1467
• Add to docs docs configuring file format options by @VioletM in #1543
• Added how dlt uses arrow by jorrit by @dat-a-man in #1577
• docs/514 rest_api: docs on pluggable paginators by @willi-mueller in #1557
• docs: documents new convert parameter in rest_api source incremental config by @willi-mueller in #1649
• Docs/1571 docs on handling NULL values at incremental cursor path by @willi-mueller in #1650
• Add note that pg_replication doesn't support scd2 by @akelad in #1608
• docs/505 updates documentation on custom hooks in response_actions by @willi-mueller in #1524

New Contributors

• @donotpush made their first contribution in #1559
• @thisisdope made their first contribution in #1573
• @akelad made their first contribution in #1608

Full Changelog: 0.5.1...0.5.2