New
- [dagster-aws] Added an
env_vars
field to the EcsRunLauncher that allows you to configure environment variables in the ECS task for launched runs. - [dagster-k8s] The
env_vars
field onK8sRunLauncher
andk8s_job_executor
can now except input of the form ENV_VAR_NAME=ENV_VAR_VALUE, and will set the value of ENV_VAR_NAME to ENV_VAR_VALUE. Previously, it only accepted input of the form ENV_VAR_NAME, and the environment variable had to be available in the pod launching the job. - [dagster-k8s] setting ‘includeConfigInLaunchedRuns’ on a user code deployment will now also include any image pull secrets from the user code deployment in the pod for the launched runs.
Bugfixes
- A recent change had made it so that, when
IOManager.load_input
was called to load an asset that was not being materialized as part of the run, the provided context would not include the metadata for that asset.context.upstream_output.metadata
now correctly returns the metadata on the upstream asset. - Fixed an issue where using generic type aliases introduced in Python 3.9 (like
list[str]
) as the type of an input would raise an exception. - [dagster-k8s] Fixed an issue where upgrading the Helm chart version without upgrading your user code deployment version would result in an “Received unexpected config entry "scheme" at path root:postgres_db" error.
All Changes
0.14.19...0.14.20
See All Contributors
0.14.20rc0
by @elementl-devtools
Fixes for asset graphql tests to make them easier to generalize and call with other graphql context fixtures (#8199)
by @gibsondan
bring back source asset metadata (#8195)
by @sryza
fix is_subclass bug where issubclass(list[str], DagsterType) throws a surprising exception (#8287)
by @gibsondan
Add max_retries to user editable tags (#8285)
by @johannkm
Derive origin from pipeline run instead of the arg to ExecuteRunArgs (#8156)
by @gibsondan
add an "environment" key to EcsRunLauncher / EcsContainerContext that sets env vars (#8243)
by @gibsondan
Fix upgrade story for new scheme field in postgres (#8220)
by @gibsondan
Add image pull secrets to k8s container context (#8221)
by @gibsondan
extract event connection to top-level graphql query (#8077)
by @prha
Create unified storage configuration for
dagster.yaml (#7283)
by @prha
[dagster-dbt] Fix bug where a dbt invocation that did not successfully start could emit materialization events. (#8293)
by @OwenKephart
Move config editor to core so we can reuse in admin portal (#8237)
by @salazarm
Make dagster/reexecution_strategy tag editable (#8286)
by @johannkm
only return config field for solids (#8278)
by @clairelin135
clean up create_pg_connection (#8165)
by @alangenfeld
0.14.20 Changelog (#8301)
by @johannkm
0.14.20
by @elementl-devtools