New
- Metadata can now be added to jobs (via the
metadataparameter) and viewed in dagit. You can use it to track code owners, link to docs, or add other useful information. - In the Dagit launchpad, the panel below the config editor now shows more detailed information about the state of the config, including error state and whether the config requires further scaffolding or the removal of extra config.
- FileCache is now marked for deprecation in 0.15.0.
- In Dagit, the asset catalog now shows the last materialization for each asset and links to the latest run.
- Assets can now have a
config_schema. If you attempt to materialize an asset with a config schema in Dagit, you'll be able to enter the required config via a modal.
Bugfixes
- [helm] Fixed an issue where string floats and integers were not properly templated as image tags.
- [dagster-k8s] Fixed an issue when using the
k8s_job_executorwhere ops with long names sometimes failed to create a pod due to a validation error with the label names automatically generated by Dagster. - [dagster-aws] Fixed an issue where ECS tasks with large container contexts would sometimes fail to launch because their request to the ECS RunTask API was too large.
Breaking Changes
fs_asset_io_managerhas been removed in favor of merging its functionality withfs_io_manager.fs_io_manageris now the default IO manager for asset jobs, and will store asset outputs in a directory named with the asset key.
Community Contributions
- Fixed a bug that broke the
k8s_job_executor’smax_conccurentconfiguration. Thanks @fahadkh! - Fixed a bug that caused the
fs_io_managerto incorrectly handle assets associated with upstream assets. Thanks @aroig!
Documentation
- [helm] Add documentation for code server image pull secrets in the main chart.
- The Dagster README has been revamped with documentation and community links.
All Changes
0.14.17...0.14.19
See All Contributors
Automation: versioned docs for 0.14.17 by @elementl-devtools
Revert "throw error for empty asset key (#8069)" (#8093) by @gibsondan
[dagit] Launchpad: Show disabled "Scaffold" and "Remove" buttons instead of hiding them (#8066) by @hellendag
chore(buildkite): mention user in private channel (#8071) by @rexledesma
[asset-resources 2/n][rfc] io manager defs directly on asset defs (#7920) by @dpeng817
docs: revamp the README (#8052) by @rexledesma
0.14.17 changelog (#8083) by @smackesey
Fix upstream context handling in fs_asset_io_manager (#8007) by @aroig
KnownState.ready_outputs (#8016) by @alangenfeld
chore: mark FileCache for deprecation in 0.15.0 (#7922) by @rexledesma
remove step stats query (#8089) by @clairelin135
migrate from deprecated sqlalchemy methods (#7864) by @alangenfeld
fix typos (#8090) by @OwenKephart
Add skip for flaky grpc server test (#8097) by @gibsondan
chore(buildkite): ignore notifications on canceled builds (#8099) by @rexledesma
[dagit] Break apart LaunchpadSessionContainer (#8101) by @hellendag
[dagit] Small changes to the asset catalog (#7993) by @bengotow
[dagit] Track partition set sort order for Launchpad (#8104) by @hellendag
Lint rule to make sure queries requiring QueryVariables have them (#8102) by @salazarm
Make dagster-images build work when it is called outside of a git repo (#8088) by @gibsondan
Fix configuration schema for k8s executor (#8107) by @fahadkh
[dagit] Clean up some yarn peer deps (#8108) by @hellendag
Add latestRun resolver to AssetsLatestInfo (#8072) by @clairelin135
Handle op outputs in default asset IO manager (#8074) by @clairelin135
[dagit] Add last materialization, latest run columns to the asset table (#7996) by @bengotow
fix(mypy): refine types (#8129) by @rexledesma
fix(helm): allow numeric quoted strings as image tags (#8120) by @rexledesma
docs: add a button to copy/paste code snippets (#8106) by @yuhan
[asset-resources 4/n][rfc] Refactor resource requirement checking code (#7947) by @dpeng817
fix(helm): use templated comment (#8137) by @rexledesma
docs(helm): add doc hint for dagster-user-deployments.imagePullSecrets (#8112) by @ceefour
Added group_name to asset (#8110) by @shalabhc
Fix invocation on ops that use generic dynamic outputs (#8133) by @dpeng817
[dagit] Show more information for last run on Schedules/Sensors (#8130) by @hellendag
KnownState parent run info (#8030) by @alangenfeld
add metadata to jobs (#7849) by @jamiedemaria
fix dagit-debug (#8148) by @alangenfeld
add kwargs to pipeline snapshot from storage (#8149) by @jamiedemaria
Fix label sanitization for strings that end in a period (#8151) by @gibsondan
[dagit] Fix duplicate styled-components (#8144) by @hellendag
Basic asset config (#7590) by @smackesey
chore(helm): christen the code server service port name as grpc (#8142) by @calebfornari
feat(helm): allow the postgresql scheme to be configurable (#8126) by @peay
Avoid launching ECS runs with large overrides (#8152) by @jmsanders
[dagit] Remove clear-site-data header (#8134) by @hellendag
fix(helm): use pre-2022 bitnami repository (#8166) by @rexledesma
Asset config gql resolver (#8163) by @smackesey
Merge branch 'release-0.14.18' of https://github.com/dagster-io/dagster into release-0.14.18 by @OwenKephart
changes (#8169) by @OwenKephart
[dagit] asset Config (#8154) by @smackesey
0.14.18 by @elementl-devtools
0.14.18rc5 by @elementl-devtools
0.14.18rc6 by @elementl-devtools
[easy] 0.14.18 => 0.14.19 in changelog (#8180) by @gibsondan
0.14.19 by @elementl-devtools