Core Library
- Add
upsert
merge strategy for Postgres and Snowflake, by @jorritsandbrink in #1466 - Add basic
upsert
support fordelta
table format infilesystem
destination by @jorritsandbrink in #1600 - query tagging for snowflake by @rudolfix in #1582
- Support Open Source ClickHouse Deployments (MergeTree engine and more) by @Pipboyguy in #1496
- allows nested types in BigQuery via native
autodetect_schema
by @rudolfix in #1591 - Enable
upsert
merge strategy for more SQL destinations (Athena, BigQuery, Databricks, mssql) by @jorritsandbrink in #1628 - Fix/1512 fixes
current.pipeline()
access by @rudolfix in #1581 - feat: add config dataset_name_prefix to set custom staging dataset name by @donotpush in #1563
- fix: add airflow db reset for all tests by @donotpush in #1559
- Enable S3 compatible storage for
delta
table format by @jorritsandbrink in #1586 - feat/1495 rest_client: renames JSONResponsePaginator to JSONLinkPaginator by @willi-mueller in #1558
- Feat/1596 adds custom config providers + example of yaml config provider supporting profiles and jinja placeholders by @rudolfix in #1642
- Feat/1583 rest client session timeout configuration by @willi-mueller in #1590
- Add clarification for add_limit by @VioletM in #1594
- Fix/1606 fixes validator incremental step order to keep it always last in the pipe by @rudolfix in #1641
- Feat/1593 rest_client: allow setting of request kwargs by @willi-mueller in #1609
- prevent accidental wrapping of sources in resources when using adapters by @sh-rp in #1645
- Add empty source handling for
delta
table format onfilesystem
destination by @jorritsandbrink in #1617 - Surface original err msg from pydantic as extended_info on DataValidationError by @codingcyclist in #1569
- fix(dockerfile): remove extra spaces around equals sign in LABEL inst… by @thisisdope in #1573
- Qdrant uncommitted state restore and test by @steinitzu in #1545
- fix: suppress alembic logs for tests by @donotpush in #1578
Docs
- Document sql source reflection level and type adapter by @steinitzu in #1467
- Add to docs docs configuring file format options by @VioletM in #1543
- Added how dlt uses arrow by jorrit by @dat-a-man in #1577
- docs/514 rest_api: docs on pluggable paginators by @willi-mueller in #1557
- docs: documents new
convert
parameter in rest_api source incremental config by @willi-mueller in #1649 - Docs/1571 docs on handling NULL values at incremental cursor path by @willi-mueller in #1650
- Add note that pg_replication doesn't support scd2 by @akelad in #1608
- docs/505 updates documentation on custom hooks in response_actions by @willi-mueller in #1524
New Contributors
- @donotpush made their first contribution in #1559
- @thisisdope made their first contribution in #1573
- @akelad made their first contribution in #1608
Full Changelog: 0.5.1...0.5.2