New
DagsterRun
now has ajob_name
property, which should be used instead ofpipeline_name
.TimeWindowPartitionsDefinition
now has aget_partition_keys_in_range
method which returns a sequence of all the partition keys between two partition keys.OpExecutionContext
now hasasset_partitions_def_for_output
andasset_partitions_def_for_input
methods.- Dagster now errors immediately with an informative message when two
AssetsDefinition
objects with the same key are provided to the same repository. build_output_context
now accepts apartition_key
argument that can be used when testing thehandle_output
method of an IO manager.
Bugfixes
- Fixed a bug that made it impossible to load inputs using a DagsterTypeLoader if the InputDefinition had an
asset_key
set. - Ops created with the
@asset
and@multi_asset
decorators no longer have a top-level “assets” entry in their config schema. This entry was unused. - In 0.15.6, a bug was introduced that made it impossible to load repositories if assets that had non-standard metadata attached to them were present. This has been fixed.
- [dagster-dbt] In some cases, using
load_assets_from_dbt_manifest
with aselect
parameter that included sources would result in an error. This has been fixed. - [dagit] Fixed an error where a race condition of a sensor/schedule page load and the sensor/schedule removal caused a GraphQL exception to be raised.
- [dagit] The “Materialize” button no longer changes to “Rematerialize” in some scenarios
- [dagit] The live overlays on asset views, showing latest materialization and run info, now load faster
- [dagit] Typing whitespace into the launchpad Yaml editor no longer causes execution to fail to start
- [dagit] The explorer sidebar no longer displays “mode” label and description for jobs, since modes are deprecated.
Community Contributions
- An error will now be raised if a
@repository
decorated function expects parameters. Thanks @roeij!
Documentation
- The non-asset version of the Hacker News example, which lived inside
examples/hacker_news/
, has been removed, because it hadn’t received updates in a long time and had drifted from best practices. The asset version is still there and has an updated README. Check it out here
All Changes
0.15.6...0.15.7
See All Contributors
Correct check for pickle s3 io manager (#8834)
by @ripplekhera
[dagit] Always show “Materialize” instead of “Rematerialize” based on status (#8711)
by @bengotow
[dagster-dbt] make group configurable for load_assets_from_dbt (#8863)
by @OwenKephart
asset_partitions_def on InputContext and OutputContext (#8858)
by @sryza
[dagster-dbt] refactor the dbt asset integration (#8793)
by @OwenKephart
PartitionMappings when non-partitioned assets depend on partitioned assets (#8866)
by @sryza
[dagster-dbt] seeds and snapshots are assets when using dbt build (#8794)
by @OwenKephart
Document valid names for asset keys (#8765)
by @jamiedemaria
[docs] Dagster + dbt guide (#8714)
by @OwenKephart
0.15.6 changelog (#8876)
by @yuhan
provide description for MAP ConfigType (#8824)
by @Jiafi
Retrieve minimal set of asset records for assetsLatestInfo (#8835)
by @bengotow
error when duplicate asset keys on a repository (#8874)
by @sryza
[docs] - Add Airflow Operator to Op Docs (#8875)
by @clairelin135
dagster-datahub Rest and Kafka Emitter integration (#8764)
by @Jiafi
Automation: versioned docs for 0.15.6
by @elementl-devtools
[1.0] move solid to dagster.legacy (#8843)
by @dpeng817
Extract ECS task overrides (#8842)
by @jmsanders
[graphql] tolerate empty runConfigData (#8886)
by @alangenfeld
[dagit] Fix edge case where “ “ launchpad config is not coerced to an empty object (#8895)
by @bengotow
Fix ScheduleRootQuery typo (#8903)
by @johannkm
unloadable shit (#8887)
by @prha
Change base image for OSS release builds (#8902)
by @gibsondan
change deprecation warnings to 1.0 (#8892)
by @dpeng817
update README for hacker news assets example (#8904)
by @sryza
[hacker news] add missing key prefix to activity analytics python assets (#8817)
by @sryza
[buildkite] Specify internal branch used for compatibility pipeline (#8881)
by @smackesey
[dagit] Remove “mode” label and description in explorer sidebar (#8907)
by @bengotow
remove the non-asset version of the hacker news example (#8883)
by @sryza
Error when @repository-decorated function has arguments (#8913)
by @roeij
[docs] - Correct snippets for dbt (#8923)
by @erinkcochran87
[bug] fix input loading regression (#8885)
by @OwenKephart
[docs] - graph backed assets doc fix (#8927)
by @jamiedemaria
silence system-originated experimental warning for PartitionMapping (#8931)
by @sryza
Add partition key to build_output_context, add documentation for partition_key on build_op_context (#8774)
by @dpeng817
fix dimensions of screenshot on connecting ops tutorial page (#8908)
by @sryza
ttv: remove undocumented/legacy example - user in loop (#8934)
by @yuhan
[docs] - Clean up graph-backed asset example, put under test (#8893)
by @dpeng817
[docs] - Fix garbled sentence in ops.mdx (#8935)
by @schrockn
enable getting asset partitions def from op context (#8924)
by @sryza
Increase test_docker_monitoring timeout (#8906)
by @johannkm
PartitionsDefinition.get_partition_keys_in_range (#8933)
by @sryza
Move pipeline to dagster.legacy (#8888)
by @dpeng817
[dagit] Rename search open event (#8954)
by @hellendag
[dagit] Adjust shift-selection behavior in asset graphs (#8950)
by @bengotow
[dagit] Clean up code around the graph sidebar (#8914)
by @bengotow
add a job_name property to PipelineRun (#8928)
by @sryza
remove partition entries from asset op config schema (#8951)
by @sryza
avoid pipelines in run status sensor doc snippets (#8929)
by @sryza
[bug] Fix issue where 'invalid' asset metadata resulted in an error (#8947)
by @OwenKephart
[dagster-dbt] fix tagged source asset loading (#8943)
by @OwenKephart
fix black in run status sensor docs example (#8974)
by @sryza
[known state] fix build_for_reexecution bug (#8975)
by @alangenfeld
Document deprecation of MetadataEntry static constructors (#8984)
by @smackesey
changelog (#8986)
by @jamiedemaria
0.15.7
by @elementl-devtools