dagster-io/dagster 1.12.19

1.12.19 (core) / 0.28.19 (libraries)

on GitHub

New

• Added a "Report Execution" dialog to the asset checks detail view, allowing users to manually record check evaluation results.
• Added database pool configuration options (--db-pool-recycle, --db-pool-pre-ping, and others) to dg dev and dagster dev.
• Added dg plus config view command for inspecting the current CLI configuration.
• [ui] Updated the Usage dialog and Run timeline to display "Jobless asset materializations" (previously "Ad hoc materializations") with a tooltip describing what is grouped within this category.
• [ui] Planned run events are now excluded from the event count shown in the run log filter.
• [dagster-azure] Added component support for dagster-azure, including AzureBlobStorageResourceComponent and ADLS2ResourceComponent for declarative YAML configuration of Azure resources.
• [dagster-databricks] DatabricksAssetBundleComponent is now subsettable at the job level, enabling selective execution of individual Databricks tasks.
• [dagster-databricks] DatabricksAssetBundleComponent now uses the Databricks CLI to resolve variable references to task and job names in bundle templates.
• [dagster-databricks] Databricks jobs are now cancelled when the corresponding Dagster run is terminated in DatabricksWorkspaceComponent.
• [dagster-dbt] dagster-dbt now prefers dbt-core for manifest parsing when it is installed.
• [dagster-gcp] Added BigQueryResourceComponent, GCSResourceComponent, GCSFileManagerResourceComponent, and DataprocResourceComponent for declarative YAML configuration of GCP resources.
• [dagster-gcp] BigQueryIOManager now supports a configurable write_mode parameter (truncate, replace, or append).

Bugfixes

• Fixed an issue where auto-run reexecution would attempt to rerun jobs belonging to already-completed or cancelled backfills.
• Fixed an issue where backfill errors that were subsequently retried would remain incorrectly associated with the backfill.
• dg plus pull env now merges pulled secrets into the existing .env file instead of replacing it, preserving any locally-set variables not present in Dagster Plus.
• [ui] Fixed rendering of newlines in markdown blockquotes in the UI.
• [dagster-databricks] Fixed a KeyError for run_page_url in DatabricksWorkspaceComponent.
• [dagster-databricks] Fixed asset mapping in DatabricksAssetBundleComponent and DatabricksWorkspaceComponent to use job and task key combinations, preventing conflicts when task keys are not unique across jobs.

Dagster Plus

• The Dagster+ agent now automatically redeploys local code servers that enter a failure state when the control plane expects them to be loaded.