OpenLineage/OpenLineage 1.26.0 on GitHub

1.26.0 - 2024-12-20

dbt: Consume dbt structured logs and report progress in real time. #3314 @MassyB
If --consume-structured-logs flag is set, dbt integration will consume dbt structured logs and report execution progress in real time.
Java: Add transform transport to allow event modification. #3301 @pawel-big-lebowski
New transport type allows to modify the event based on the specified transformer class.
Java: Parallel event emitting for composite transport. #3305[#3305] @pawel-big-lebowski
Emit events in parallel for composite transport. Running in parallel is a default behaviour continueOnFailure set to true. Default value of continueOnFailure got changed from false to true.
Spark: Collect ScanReport and CommitReport in OpenLineage events when dealing with Iceberg tables. #3256 @pawel-big-lebowski
Collects additional Iceberg metrics for datasets read or written through the library. Visit Dataset Metrics docs for more details.
dbt: add support for duckdb adapter #3280 @mobuchowski
Adds support for duckdb adapter for dbt integration.

Spark: Add DatasetFactory to support Dataset creation. #3207 @pawel-big-lebowski
Adds DatasetFactory to support Dataset creation. This class is used to create Dataset instances for DatasetFactory.

Spark: fix inconsistent dataset naming #3285 @pawel-big-lebowski
GCS path now has correctly stripped leading slash