helm/dagster/dagster 1.9.7

1.9.7 (core) / 0.25.7 (libraries)

on Artifact Hub

New

• Added new function load_definitions_from_module, which can load all the assets, checks, schedules, sensors, and job objects within a module scope into a single Definitions object. Check out the documentation to learn more: https://docs.dagster.io/_apidocs/definitions#dagster.load_definitions_from_module.
• Previously, asset backfills could only target selections of assets in which all assets had a BackfillPolicy, or none of them did. Mixed selections are now supported.
• AssetSpecs may now contain a partitions_def. Different AssetSpecs passed to the same invocation of @multi_asset can now have different PartitionsDefinitions, as long as can_subset=True.
• Added the option to use a thread pool to process backfills in parallel.
• Exceptions that are raised when a schedule or sensor is writing to logs will now write an error message to stdout instead of failing the tick.
• Added validation of title for asset backfills (not just for job backfills).
• [ui] Design tweaks to the asset Automations tab.
• [ui] Asset selection filtering is now case insensitive.
• [ui] Add Teradata icon for kind tags.
• [ui] When creating and editing alerts, when the form is in an invalid state, display the reason on the disabled buttons.
• [ui] Add Automation history to asset checks.
• [ui] Improve performance of Run page for very long-running runs.
• [dagster-airbyte] The airbyte_assets decorator has been added. It can be used with the AirbyteCloudWorkspace resource and DagsterAirbyteTranslator translator to load Airbyte tables for a given connection as assets in Dagster. The build_airbyte_assets_definitions factory can be used to create assets for all the connections in your Airbyte workspace.
• [dagster-airbyte] Airbyte Cloud assets can now be materialized using the AirbyteCloudWorkspace.sync_and_poll(…) method in the definition of a @airbyte_assets decorator.
• [dagster-airlift] Airflow imports are now compatible with Airflow 1.
• [dagster-aws] new ecs_executor which executes Dagster steps via AWS ECS tasks. This can be used in conjunction with ECSRunLauncher.
• [dagster-dbt] dbt-core>=1.9 is now supported.
• [dagster-dbt] Adds SQL syntax highlighting to raw sql code in dbt asset descriptions.
• [dagster-looker] load_looker_asset_specs and build_looker_pdt_assets_definitions are updated to accept an instance of DagsterLookerApiTranslator or custom subclass.
• [dagster-looker] Type hints in the signature of DagsterLookerApiTranslator.get_asset_spec have been updated - the parameter looker_structure is now of type LookerApiTranslatorStructureData instead of LookerStructureData. Custom Looker API translators should be updated.
• [dagster-powerbi] load_powerbi_asset_specs has been updated to accept an instance of DagsterPowerBITranslator or custom subclass.
• [dagster-powerbi] Type hints in the signature of DagsterPowerBITranslator.get_asset_spec have been updated - the parameter data is now of type PowerBITranslatorData instead of PowerBIContentData. Custom Power BI translators should be updated.
• [dagster-sigma] load_sigma_asset_specs has been updated to accept an instance of DagsterSigmaTranslator or a custom subclass.
• [dagster-sigma] Type hints in the signature of DagsterLookerApiTranslator.get_asset_spec have been updated - the parameter data is now of type Union[SigmaDatasetTranslatorData, SigmaWorkbookTranslatorData] instead of Union[SigmaDataset, SigmaWorkbook]. Custom Looker API translators should be updated.
• [dagster-sigma] Added the option to filter to specific workbooks in addition to folders.
• [dagster-sigma] Added the option to skip fetching lineage for workbooks in cases where users want to build this information themselves.
• [dagster-tableau] load_tableau_asset_specs has been updated to accept an instance of DagsterTableauTranslator or custom subclass.
• [dagster-tableau] Type hints in the signature of DagsterTableauTranslator.get_asset_spec have been updated - the parameter data is now of type TableauTranslatorData instead of TableauContentData. Custom Tableau translators should be updated.

Bugfixes

• Fixed an issue where sensor and schedule tick logs would accumulate disk over time on Dagster code servers.
• [ui] Fixed an issue where the app sometimes loads with styles missing.
• [ui] Fix search string highlighting in global search results.
• Fixed a race condition where immediately after adding a new asset to the graph, a freshness check sensor targeting that asset might raise an InvalidSubsetError in its first one.
• [ui] Fixed a bug where backfills launched by Declarative Automation were not being shown in the table of launched runs.
• The dagster-airlift package erroneously introduced a dependency on dagster. This has been rectified - dagster is only required for the dagster-airlift[core] submodule.

Deprecations

• Deprecation of @multi_asset_sensor has been rolled back.

Dagster Plus

• Introduce the Catalog Viewer role for Users and Teams.
• Slack, MS Teams, and email alerts for run failures will list the steps that were successful or not executed.
• [experimental] The option blobStorageSnapshotUploads has been added which enables a new process for how definition snapshots are uploaded to Dagster Cloud.
• Fixed a catalog search issue where exact prefix matches are not prioritized in the search results.
• Fixed a bug with Insights metric customization.