New
- Tags can now be provided to an asset reconciliation sensor and will be applied to all RunRequests returned by the sensor.
- If you don’t explicitly specify a DagsterType on a graph input, but all the inner inputs that the graph input maps to have the same DagsterType, the graph input’s DagsterType will be set to the the DagsterType of the inner inputs.
- [dagster-airbyte]
load_assets_from_airbyte_project
now caches the project data generated at repo load time so it does not have to be regenerated in subprocesses. - [dagster-airbyte] Output table schema metadata is now generated at asset definition time when using
load_assets_from_airbyte_instance
orload_assets_from_airbyte_project
. - [dagit] The run timeline now groups all jobs by repository. You can collapse or expand each repository in this view by clicking the repository name. This state will be preserved locally. You can also hold
Shift
while clicking the repository name, and all repository groups will be collapsed or expanded accordingly. - [dagit] In the launchpad view, a “Remove all” button is now available once you have accrued three or more tabs for that job, to make it easier to clear stale configuration tabs from view.
- [dagit] When scrolling through the asset catalog, the toolbar is now sticky. This makes it simpler to select multiple assets and materialize them without requiring you to scroll back to the top of the page.
- [dagit] A “Materialize” option has been added to the action menu on individual rows in the asset catalog view.
- [dagster-aws] The
EcsRunLauncher
now allows you to pass in a dictionary in thetask_definition
config field that specifies configuration for the task definition of the launched run, including role ARNs and a list of sidecar containers to include. Previously, the task definition could only be configured by passing in a task definition ARN or by basing the the task definition off of the task definition of the ECS task launching the run. See the docs for the full set of available config.
Bugfixes
- Previously, yielding a
SkipReason
within a multi-asset sensor (experimental) would raise an error. This has been fixed. - [dagit] Previously, if you had a partitioned asset job and supplied a hardcoded dictionary of config to
define_asset_job
, you would run into aCheckError
when launching the job from Dagit. This has been fixed. - [dagit] When viewing the Runs section of Dagit, the counts displayed in the tabs (e.g. “In progress”, “Queued”, etc.) were not updating on a poll interval. This has been fixed.
All Changes
1.0.13...1.0.14
See All Contributors
Fix materialization count by partition (#9979)
by @clairelin135
[dagit] Turn on timeline run bucketing for everyone (#9993)
by @hellendag
[dagit] "Remove all" tab button to clear Launchpad tabs (#9981)
by @hellendag
[dagit] Add polling to Overview pages (#9996)
by @hellendag
Return each Python PackageSpec's distribution (#9889)
by @jmsanders
[dagster-airbyte] Support union types while generating normalization tables (#9937)
by @benpankow
[dagster-airbyte] Add option to specify custom API request params to Airbyte resource (#10000)
by @benpankow
View Notebook button opens notebook as link if it's a url (#9894)
by @jamiedemaria
IO manager concept doc improvements (#9987)
by @sryza
[dagster-airbyte] Add optional connection name filter when generating assets (#9975)
by @benpankow
[docs] Update deployment settings reference with SSO default role (#9984)
by @benpankow
[docs] - dbt-focused intro tutorial (#9853)
by @jamiedemaria
Configure tokens -> Tokens (#9999)
by @salazarm
add a link to discuss.dagster.io on README (#10002)
by @yuhan
1.0.13 changelog (#10010)
by @yuhan
[fix] fix docs bk error (#10014)
by @benpankow
Only add buildkite steps for affected changes (#9897)
by @jmsanders
[dagit] Add daemon alerts to Overview schedules/sensors pages (#9972)
by @hellendag
[dagit] Make asset catalog toolbar sticky (#9974)
by @hellendag
[dagit] Update workspace flag label (#9994)
by @hellendag
fix code example in create_databricks_job_op (#10012)
by @sryza
Fixup setup paths (#10019)
by @jmsanders
Skip Python checks if no Python files change (#10016)
by @jmsanders
Skip package steps instead of excluding them (#10018)
by @jmsanders
Don't raise an exception when changing the EcsRunLauncher's container name to a new name (#10026)
by @gibsondan
[event log tests] add origin to run (#10017)
by @alangenfeld
move the big honkin asset graph to latest asset APIs (#10025)
by @sryza
Conditionally skip helm steps (#10031)
by @jmsanders
[dagit] Fix run tab counts not updating with poll interval (#9929)
by @hellendag
Automation: versioned docs for 1.0.13
by @elementl-devtools
Also run helm on merges to main (#10038)
by @jmsanders
[dagit] Split asset graphs onto a new “Plots” tab (#9735)
by @bengotow
[dagit] Fetch isAssetJob in WorkspaceContext, rm Launchpad tab flicker (#9770)
by @bengotow
Workaround for upstream snowflake-sqlalchemy issue (#10049)
by @gibsondan
[dagster-airbyte] Generate schema metadata at load time when loading from project or instance (#9939)
by @benpankow
[cacheable-assets] Enable use of with_resources, with_prefix_or_group on cacheable assets (#9978)
by @benpankow
[docs] Fix for asset preview image next to code block (#9881)
by @benpankow
fix credential helper links and volume path (#10046)
by @gibsondan
Refactor build python package skipping (#10037)
by @jmsanders
replace tag joins with subquery over tag intersection queries (#10036)
by @prha
Also correctly skip dagster_buildkite (#10053)
by @jmsanders
pass tags to asset reconciliation sensor (#10032)
by @jamiedemaria
infer graph input types from inner input types (#9658)
by @sryza
Add hook for launch pad root execution button (#9976)
by @salazarm
Make the default_job_io_manager overridable via env (#9950)
by @johannkm
[dagit] Jest cleanup for missing canvas context (#10035)
by @hellendag
[easy] fix incorrect cli link (#10058)
by @gibsondan
Skip integration tests (#10051)
by @jmsanders
consistent capitalization in LaunchAssetChoosePartitionsDialog (#10033)
by @sryza
Fix package skipping for dagster-test (#10063)
by @jmsanders
fix graph type inference with fan-in (#10064)
by @sryza
Fix runs yielded error for multi asset sensor (#10059)
by @clairelin135
[dagit] Add "Materialize" action item to asset action menu (#10065)
by @hellendag
[dagit] Update Backfill table styles (#10070)
by @hellendag
Raise if we can't infer distribution (#10066)
by @jmsanders
fix Dagit execution of partitioned asset jobs with hardcoded config (#10057)
by @sryza
Skip grapqhl and mysql checks (#10054)
by @jmsanders
[windows tests] fix start time == end time issue (#10021)
by @alangenfeld
[dagster-io/ui] Calculate available width for MiddleTruncate (#10052)
by @hellendag
[dagit] Add Shift+click to expand/collapse all repos in run timeline and tables (#10076)
by @hellendag
[dagit] Fix repo row expanded icon (#10077)
by @hellendag
Allow passing in task definition config to the EcsRunLauncher instead of just a task definition ARN (#10044)
by @gibsondan
bump test_execute_schedule_on_celery_k8s to 3m (#10088)
by @alangenfeld
Expose permissions loading state (#10093)
by @salazarm
Revert "Make the default_job_io_manager overridable via env (#9950)"
by @johannkm
Add helm vals for scheduler threading (#10094)
by @dpeng817
[dagit] Shift-clicking Materialize should show asset launchpad even if assets are partitioned (#10047)
by @bengotow
1.0.14 changelog (#10106)
by @dpeng817
1.0.14
by @elementl-devtools