github dlt-hub/dlt 0.2.0a16

latest releases: 1.3.0, 1.2.0, 1.1.0...
pre-release21 months ago

What's Changed

  • uses structured data types to store json by @rudolfix in #121
  • brings back the functionality to run dbt packages by @rudolfix in #122

This update changes how the complex data type is being stored. Most often complex data type is generated to hold json data when nesting_level is limited in the source. The complex types are stored as JSONB (postgres), SUPER (redshift), JSON (BigQuery)

This update also allows to easily run dbt packages together with dlt pipelines. Most of the work went into making it user friendly and avoiding any dependency conflicts. This feature is also quite well tested. Take a look at those two examples:
https://github.com/dlt-hub/dlt/blob/devel/docs/examples/dbt_run_jaffle.py
https://github.com/dlt-hub/dlt/blob/devel/docs/examples/chess/chess_dbt.py
https://github.com/dlt-hub/dlt/tree/devel/docs/examples/chess/dbt_transform

Runing the dbt package is just two lines and you have more control over it that with the CLI

Don't miss a new dlt release

NewReleases is sending notifications on new releases.