dagster-io/dagster 1.10.13

1.10.13 (core) / 0.26.13 (libraries)

on GitHub

New

• If an unselected asset check is executed during a run, the system will now warn instead of throwing a hard error.
• When evaluating AutomationCondition.any_deps_match or AutomationCondition.all_dep_match with an allow / ignore specified, an error will no longer be produced if the provided asset selection references an asset key that does not exist.
• Added the ability to restrict the list of ports that dagster dev is allowed to use to open subprocesses when running on Windows, by setting the DAGSTER_PORT_RANGE env var to a string of the form <start>=<end> - for example "20000-30000".
• [dagster-aws] The S3 sensor's get_objects now returns an empty list if no new files can be found since the since_last_modified parameter. Thanks @bartcode!
• [dagster-dbt] @dbt_assets and build_dbt_manifest_asset_selection now support a selector argument, allowing you to use yaml-based selectors.
• [dagster-k8s] improved run monitoring when running with increased backoff limits. Thanks @adam-bloom!

Bugfixes

• Fixed a bug with AutomationCondition.initial_evaluation which could cause it to return False for an asset that went from having a condition, to having no condition at all, back to having the original condition again.
• Fixed a bug that would cause the AutomationCondition.any_deps_updated() condition to evaluate to False when evaluated on a self-dependency.
• Fixed a bug in the quickstart_aws example. Thanks @Thenkei!
• [ui] Fixed navigation between asset tabs by no longer preserving query parameters from one tab to the next.
• [ui] Fixed an issue where the asset graph looked like it was still loading when it wasn't.

Documentation

• Added Scala Spark / Dagster Pipes guide.

dg & Components (Preview)

• [dg] Error message when an invalid configuration file is detected is now shorter and more clear.
• [components] Descriptions and examples have been restored for core models such as ResolvedAssetSpec. description and examples arguments have been added to Resolver for documenting fields on non-pydantic model based Resolvable classes.