- Support for the Dagster step selection DSL:
step_selection, which accepts queries like
solid_a.compute, all of its ancestors, its immediate descendants, and their immediate descendants).
steps_to_executeis deprecated and will be removed in 0.10.0.
- [dagster-databricks] Improved setup of Databricks environment (Thanks @sd2k!)
- Enabled frozenlist pickling (Thanks @kinghuang!)
- Fixed a bug that pipeline-level hooks were not correctly applied on a pipeline subset.
- Improved error messages when execute command can't load a code pointer.
- Fixed a bug that prevented serializing Spark intermediates with configured intermediate storages.
- Enabled subset reexecution via Dagit when part of the pipeline is still running.
Schedulesclickable and link to View All page in the schedule section.
- Various Dagit UI improvements.
- [lakehouse] Added CLI command for building and executing a pipeline that updates a given set of assets:
house update --module package.module —assets my_asset*
- Fixes and improvements.