dagster-io/dagster 1.12.22

1.12.22 (core) / 0.28.22 (libraries)

on GitHub

New

• [dg] dg projects can now configure agent_queue and image in pyproject.toml under [tool.dg.project], which are included in the generated dagster_cloud.yaml when running dg plus deploy.
• [dg] Added dg api job list and dg api job get commands for querying job metadata including schedules, sensors, and tags.
• [dg] Added dg api asset-check list, dg api asset-check get-executions, and dg api asset get-partition-status commands.
• [ui] The asset overview page now shows a loading spinner for "Latest materialization" while data is loading, instead of a dash.
• [ui] Removed the legacy asset catalog component and the flagAssetCatalogSidebar feature flag. The asset catalog sidebar is now always enabled.
• [ui] The pipeline snapshot link is no longer shown in the Run Actions Menu for hidden asset group jobs.
• [dagster-aws] The EcsRunLauncher and Dagster+ ECS agent now supply idempotency tokens when creating ECS services and tasks, improving retry behavior after transient failures.
• [dagster-dbt] DbtCloudComponent now supports an option to include a polling sensor for monitoring dbt Cloud job runs.

Bugfixes

• Fixed snap_to_yaml incorrectly removing empty dicts that represent valid config values for Permissive, Map, and Noneable config types.
• Fixed an issue where resources defined in parent components could incorrectly trigger DagsterInvalidDefinitionError during nested component post_processing resolution. (Thanks, @vidiyala99!)
• [dagster-aws] Fixed PipesECSClient incorrectly treating a task that failed to start as a successful execution.
• [dagster-fivetran] Fixed an incorrect connector URL format generated by the Fivetran integration.
• [ui] Fixed a performance issue where canceling a backfill before any runs executed would unnecessarily fetch the entire asset materialization history.
• [dg] Fixed dg plus deploy not correctly pulling in environment variables when refreshing definitions state for state-backed components.
• [ui] Fixed ANSI color rendering in run logs.
• [ui] Fixed a visual rendering issue with the graph depth input field.

Documentation

• Added a migration guide for moving from sensors to declarative automation.
• Added documentation for the ECS executor.

Dagster Plus

• Alert policies can now be muted for a configurable duration. Muted policies do not send notifications and show when they will resume.
• [dagster-dbt] Added dg plus integrations dbt download-manifest command to download dbt manifests from Dagster Plus for local development.