Core Library
- BigQuery project_id may be different from credentials project_id by @VioletM in #1680
- Enable schema evolution for
merge
write disposition withdelta
table format by @jorritsandbrink in #1742 - Add
storage_options
toDeltaTable.create
by @jorritsandbrink in #1686 - Fix
delta
table dangling Parquet file bug by @jorritsandbrink in #1695 - Add
delta
table partitioning support by @jorritsandbrink in #1696 - fixes load job counter displayed in progress by @rudolfix in #1702
- RESTClient: stops pagination after empty page (Feat/1637) by @willi-mueller in #1677
- Enable
scd2
record reinsert by @jorritsandbrink in #1707 scd2
custom "valid from" / "valid to" value feature by @jorritsandbrink in #1709- feat/1681 collects load job metrics and adds remote url to traces by @rudolfix in #1708
- locks trace format with a contract @rudolfix in #1708
- Feat/1711 create with not exists for dlt tables to reduce racing conditions by @rudolfix in #1740
- provides detail exception messages when cursor stored value cannot be coerced to data by @rudolfix in #1748
- Allows to configure if staging destination is truncated or left intact to config by @VioletM in #1717
- enables external location and named credential in databricks, allows abfss://container@account Azure urls by @rudolfix in #1755
- fixes #1703 and #1754 by @rudolfix in #1755
Docs:
- rest_api: documents pluggable custom auth by @willi-mueller in #1690
- Update Snowflake docs by @akelad in #1747
- Docs/issue 1661 add tip to source docs and update weaviate docs by @dat-a-man in #1662
- Add custom parent-child relationships example by @dat-a-man in #1678
- Correct the library name for mem stats to
psutil
by @deepyaman in #1733 - Replaced "full_refresh" with "dev_mode" by @dat-a-man in #1735
New Contributors
- @deepyaman made their first contribution in #1733
Full Changelog: 0.5.3...0.5.4