New
- [dagster-aws] Added an
env_varsfield to the EcsRunLauncher that allows you to configure environment variables in the ECS task for launched runs. - [dagster-k8s] The
env_varsfield onK8sRunLauncherandk8s_job_executorcan now except input of the form ENV_VAR_NAME=ENV_VAR_VALUE, and will set the value of ENV_VAR_NAME to ENV_VAR_VALUE. Previously, it only accepted input of the form ENV_VAR_NAME, and the environment variable had to be available in the pod launching the job. - [dagster-k8s] setting ‘includeConfigInLaunchedRuns’ on a user code deployment will now also include any image pull secrets from the user code deployment in the pod for the launched runs.
Bugfixes
- A recent change had made it so that, when
IOManager.load_inputwas called to load an asset that was not being materialized as part of the run, the provided context would not include the metadata for that asset.context.upstream_output.metadatanow correctly returns the metadata on the upstream asset. - Fixed an issue where using generic type aliases introduced in Python 3.9 (like
list[str]) as the type of an input would raise an exception. - [dagster-k8s] Fixed an issue where upgrading the Helm chart version without upgrading your user code deployment version would result in an “Received unexpected config entry "scheme" at path root:postgres_db" error.
All Changes
0.14.19...0.14.20
See All Contributors
0.14.20rc0 by @elementl-devtools
Fixes for asset graphql tests to make them easier to generalize and call with other graphql context fixtures (#8199) by @gibsondan
bring back source asset metadata (#8195) by @sryza
fix is_subclass bug where issubclass(list[str], DagsterType) throws a surprising exception (#8287) by @gibsondan
Add max_retries to user editable tags (#8285) by @johannkm
Derive origin from pipeline run instead of the arg to ExecuteRunArgs (#8156) by @gibsondan
add an "environment" key to EcsRunLauncher / EcsContainerContext that sets env vars (#8243) by @gibsondan
Fix upgrade story for new scheme field in postgres (#8220) by @gibsondan
Add image pull secrets to k8s container context (#8221) by @gibsondan
extract event connection to top-level graphql query (#8077) by @prha
Create unified storage configuration for dagster.yaml (#7283) by @prha
[dagster-dbt] Fix bug where a dbt invocation that did not successfully start could emit materialization events. (#8293) by @OwenKephart
Move config editor to core so we can reuse in admin portal (#8237) by @salazarm
Make dagster/reexecution_strategy tag editable (#8286) by @johannkm
only return config field for solids (#8278) by @clairelin135
clean up create_pg_connection (#8165) by @alangenfeld
0.14.20 Changelog (#8301) by @johannkm
0.14.20 by @elementl-devtools