dlt-hub/dlt 1.19.0 on GitHub

Core Library

Feat: support return_type = arrow_stream for connectorx backend by @ivasio in #3218
Feat: visual pipeline run section in dashboard by @anuunchin in #3250
ingests parquet into mssql, mysql and sqlite via ADBC by @rudolfix in #3333
fix/3165 Athena LakeFormation permissions are required even tho Lakeformation is not used by @alkaline-0 in #3271
feat: Schema.to_mermaid() by @zilto in #3364
fix/3190 Fixed the persistence issue of boundary timestamp after removing it #3367 by @alkaline-0 in #3378
feat: snowflake clustering key modifications by @jorritsandbrink in #3365
fixes athena refresh mode (iceberg data incorrectly dropped) by @rudolfix in #3313
override local marimo theme for dashboard, fix to 'light' by @djudjuu in #3337
(fix) 3346 fix trace loading: ignore trace if cannot be unpickled by @rudolfix in #3354
Reinitialize packages after exit() is called by @JayJai04 in #3300
feat: updated scaffolding template by @zilto in #3275
fix: dashboard no longer crashes on broken home cell by @djudjuu in #3348
(fix) use sparse checkout for dlt init dlthub by @rudolfix in #3356
fix: minor typos and redundant variable by @tahamuzammil100 in #3314
feat/3198 profile selection in Dashboard if enabled in workspace by @alkaline-0 in #3295
fix: make with_table_name and other functions available through `dlt.pip… by @hello-world-bfree in #3318
Redshift feature: Include STS session token in COPY CREDENTIALS. by @timH6502 in #3307
Fix: The child table column remains in the schema as a partial column with seen-null-first=True by @anuunchin in #3131
Fix: Uncalled source loses resource-level hints in pipeline.run() by @anuunchin in #3369
(fix) does not overwrite local file context in destination factory by @rudolfix in #3398
(fix) 3351 fixes default type var to allow running with old typing_extensions (ie. old Databricks clusters) by @rudolfix in #3373
Fix: pipeline_drop.init() got an unexpected keyword argument 'no_pwd' by @anuunchin in #3386
sets ducklake fingerprint to storage fingerprint by @rudolfix in #3388
Fix: Section backrgound colors and top margins in dashboard by @anuunchin in #3393

Docs

Update incorrect LLM-native workflow link (404 error) by @zjacom in #3294
Marimo Docs Page: Added Quotations to pip install ibis Command by @anair123 in #3304
add init_replication description and required permissions by @molkazhani2001 in #3020
fix notebook formatting by @ivasio in #3305
updated the sql databases configuration docs by @dat-a-man in #3107
Docs: fix footer in dark mode, add scaffoldings link by @martinibach in #3309
Add example to SQL docs: updated docs on how to filter rows using query_adapter_callback by @dat-a-man in #3253
Update deploy-with-dagster.md by @AstrakhantsevaAA in #3287
Fix DocSearch v4 styles by @burnash in #3338
Docs/release highlight 1.16-17 by @AstrakhantsevaAA in #3213
Update weaviate destination docs and version by @VioletM in #3352
(chore) fixes sqlglot from find by @rudolfix in #3357
(docs) adds community destinations by @rudolfix in #3326
Docs: Lifecycle of a dlt transformation (a sql query model of a transformation relation) by @anuunchin in #3329
docs/snowflake native app architecture docs by @kaliole in #3359
fix: Kestra links and docker image by @wrussell1999 in #3331
docs: data_quality concept page by @zilto in #3341

Chores

Enable CI run for the runtime branch by @sh-rp in #3317
Chore: Update docs npm dependencies and clean up docs build tooling by @sh-rp in #3247
fix flaky dashboard tests by @rudolfix in #3370
chore: add proper optional typehint to dlt/extract/hints.py module by @luqmansen in #3332

New Contributors

@zjacom made their first contribution in #3294
@JayJai04 made their first contribution in #3300
@anair123 made their first contribution in #3304
@martinibach made their first contribution in #3309
@hello-world-bfree made their first contribution in #3318
@tahamuzammil100 made their first contribution in #3314
@timH6502 made their first contribution in #3307
@wrussell1999 made their first contribution in #3331
@luqmansen made their first contribution in #3332

Full Changelog: 1.18.2...1.19.0