dagster-io/dagster 1.5.7

1.5.7 / 0.21.7 (libraries)

on GitHub

New

• The OpExecutionContext and AssetExecutionContext now have a partition_keys property
• [dagster-ui] The asset graph layout algorithm has been changed to a much faster one called “tight-tree”
• [dagster-ui] The Runs table filters has a top level filter for partitions
• [dagster-dbt] dbt-core==1.7.* is now supported.

Bugfixes

• Fixed an issue where some schedules skipped a tick on the day after a fall Daylight Savings Time transition.
• Fixed a bug that caused backfill policies that execute multiple partitions in a single run not to work with dynamic partitions.
• Fixed a bug that caused an error when build_schedule_from_partitioned_job was used with a job with multi-partitioned assets and the partitions_def argument wasn’t provided to define_asset_job.
• We now raise an error early if the empty string is provided as an asset’s group name (Thanks Sierrra!)
• Fixed an issue where custom setup and teardown methods were not properly called on nested Pythonic resources.
• Added a warning message when op or asset config is passed as an argument not named config.
• [dagster-cloud] Fixed an issue where overriding the default I/O manager could break the Snowflake-dbt insights job.
• [auto-materialize] Fixed an issue where materializing an unpartitioned parent of a dynamic-partitioned asset would only result in the latest dynamic partition of that asset being requested. Now, all partitions will be requested.
• [dagster-embedded-elt] Fixed an issue in dagster-embedded-elt where sling’s updated_at parameter was set to the incorrect type
• [dagster-ui] Fixed an issue in the launchpad where selecting a partition wouldn’t correctly overwrite fields using the partition’s specific configuration

Community Contributions

• A docs fix to the testing concepts page, thanks @NicolaiLolansen!
• The schema can now be overridden per asset in DB IO managers, thanks @jrstats!

Experimental

• Improved failure recovery and retry behavior when the daemon that launches auto-materialization runs fails or crashes in the middle of a tick.
• [asset-checks] UI performance for displaying check results is improved
• [asset-checks] Removed noisy experimental warning about AssetCheckKey
• [op-concurrency] Fixed a bug where concurrency slots were not getting assigned if a run that was assigned a slot was deleted before the slot had actually been claimed during execution.
• [dagster-pipes] The PipesSubprocessClient now inherits the environment variables of the parent process in the launched subprocess.
• [dagster-pipes] Exceptions are now reported in the event log for framework components and from the external process.

Documentation

• Added a guide for using Dagster Pipes with Databricks