New
- [dagit] The run timeline now shows all future schedule ticks for the visible time window, not just the next ten ticks.
- [dagit] Asset graph views in Dagit refresh as materialization events arrive, making it easier to watch your assets update in real-time.
- [dagster-airbyte] Added support for basic auth login to the Airbyte resource.
- Configuring a Python Log Level will now also apply to system logs created by Dagster during a run.
Bugfixes
- Fixed a bug that broke asset partition mappings when using the
key_prefixwith methods likeload_assets_from_modules. - [dagster-dbt] When running dbt Cloud jobs with the dbt_cloud_run_op, the op would emit a failure if the targeted job did not create a run_results.json artifact, even if this was the expected behavior. This has been fixed.
- Improved performance by adding database indexes which should speed up the run view as well as a range of asset-based queries. These migrations can be applied by running
dagster instance migrate. - An issue that would cause schedule/sensor latency in the daemon during workspace refreshes has been resolved.
- [dagit] Shift-clicking Materialize for partitioned assets now shows the asset launchpad, allowing you to launch execution of a partition with config.
Community Contributions
- Fixed a bug where asset keys with
-were not being properly sanitized in some situations. Thanks @peay! - [dagster-airbyte] A list of connection directories can now be specified in
load_assets_from_airbyte_project. Thanks @adam-bloom! - [dagster-gcp] Dagster will now retry connecting to GCS if it gets a
ServiceUnavailableerror. Thanks @cavila-evoliq! - [dagster-postgres] Use of SQLAlchemy engine instead of psycopg2 when subscribing to PostgreSQL events. Thanks @peay!
Experimental
- [dagster-dbt] Added a
display_raw_sqlflag to the dbt asset loading functions. If set to False, this will remove the raw sql blobs from the asset descriptions. For large dbt projects, this can significantly reduce the size of the generated workspace snapshots. - [dagit] A “New asset detail pages” feature flag available in Dagit’s settings allows you to preview some upcoming changes to the way historical materializations and partitions are viewed.
All Changes
1.0.14...1.0.15
See All Contributors
[dagit] Add actions to run timeline empty state (#10092) by @hellendag
fix future ticks cursor when no ticks are available (#10095) by @prha
Revert "Make the default_job_io_manager overridable via env (#9950)" by @johannkm
Add helm vals for scheduler threading (#10094) by @dpeng817
[dagit] Shift-clicking Materialize should show asset launchpad even if assets are partitioned (#10047) by @bengotow
Remove references to services in docker-compose down command test fixture (#10042) by @dpeng817
1.0.14 changelog (#10106) by @dpeng817
1.0.14 changelog addendum (#10107) by @gibsondan
[dagit] Show all future ticks in the timeline window (#10097) by @hellendag
[dagster-postgres] Use SQLAlchemy engine in pynotify instead of psycopg2 directly (#10090) by @peay
Jb/Docs UI Cleanup (#10050) by @braunjj
[mypy] fixes for uvicorn types (#10108) by @alangenfeld
Revert "Revert "Make the default_job_io_manager overridable via env (#9950)"" by @johannkm
[dagit] Use gray tags in repo headers (#10078) by @hellendag
Run make mdx-format (#10113) by @jmsanders
Upgrade kind (#9992) by @jmsanders
rebuild event log indices to include id (#10105) by @prha
[dagit] Fix repo bucket sorting in virtualized tables (#10101) by @hellendag
Automation: versioned docs for 1.0.14 by @elementl-devtools
docs(slack-alert-policies): add slack bot name to setup instructions (#10116) by @rexledesma
[dagit] Some typographic and spacing tweaks on virtualized tables (#10118) by @hellendag
Don't gate on elementl emails (#10119) by @jmsanders
Skip docs changes (#10030) by @jmsanders
[docs] - improve partitioned asset examples on partitions concepts page (#10084) by @sryza
Walk the Python dependency tree (#10096) by @jmsanders
[dagit] Add some right padding to clearable text input (#10129) by @hellendag
[dagster-airbyte] Docs for how to use basic auth in current release (#10131) by @benpankow
Cache docstring check (#10127) by @schrockn
[dagster-airbyte] Docs fix using with_resources with cacheable asset (#10132) by @benpankow
Retry on Service Unavailable (#10110) by @cavila-evoliq
Make AssetKey.__eq__ more efficient (#10139) by @schrockn
[docs formatter] Drop mypy ignore lines in docs (#10138) by @benpankow
[refactor] take logic for base asset jobs out of AssetGroup (#10071) by @sryza
[dagit] Subscribe to in progress asset runs, refresh on relevant events (#10028) by @bengotow
docs: add h1 header to Dagster readme (#10156) by @rexledesma
docs: update @dagsterio -> @dagster (#10158) by @rexledesma
Use instance.python_log_level when determining default system logger level (#10073) by @gibsondan
in hacker news demo, fix column filtering with partitions and snowfla… (#10141) by @sryza
Allow overriding svg with color (#10163) by @salazarm
[dagster-airbyte] Add top-level support for basic auth username & password (#10130) by @benpankow
improve api doc examples for cloud object store IO managers (#10153) by @sryza
switch order of assets and jobs in partitions doc (#10142) by @sryza
Fix AssetsDefinition.with_prefix_or_group to update partition mappings (#10164) by @peay
Fix assets with dashes in their path and io_manager_def (#10087) by @peay
Refactor db io manager to core (#10128) by @jamiedemaria
docs design: fix icons. make icon changes backcompat (#10174) by @yuhan
Support multi-repo builds (#10135) by @jmsanders
[docs] Out -> AssetOut docs tweak (#10146) by @benpankow
Conditionally skip dagit builds (#10165) by @jmsanders
[dagster-managed-elements] Dagster-managed-elements CLI, APIs (#10011) by @benpankow
EventLogRecord.partition_key and EventLogRecord.asset_key (#10180) by @sryza
[dagster-airbyte] Airbyte managed elements impl (#10013) by @benpankow
[dagster-airbyte] allow filtering connections by directory names (#10151) by @adam-bloom
make_airflow_dag airflow 2 compatibility (#10115) by @Ramshackle-Jamathon
[dagit] Bump TypeScript (#10133) by @hellendag
[@dagster-io/ui] Release v1.0.6 (#10188) by @hellendag
[dagster-dbt] allow missing run_results.json (#10187) by @OwenKephart
docs(dagster-cloud-agent): update IAM role link (#10189) by @rexledesma
[dagit] Expand run config dialog (#10173) by @hellendag
Replace custom in-memory logic with in-memory sqlite connection (#10154) by @prha
add cpu and memory to DagsterEcsTaskDefinitionConfig (#10198) by @gibsondan
Allow silencing failures with default io manager override (#10067) by @johannkm
[dagster-airbyte] Managed elements typo (#10196) by @benpankow
[dagit] Consolidate expand/collapse state in Overview tables (#10194) by @hellendag
reduce locking in workspace reload (#10192) by @alangenfeld
[dagster-dbt] add flag to make asset snapshots smaller (#10213) by @OwenKephart
Extend default timeout (#10205) by @jmsanders
[dagster-airbyte] Fix recreating source/destination logic (#10197) by @benpankow
Revert 4938f9beb9 and ec3c5099c2 by @johannkm
Make handleLaunchResult agnostic to the query that returned the data (#10179) by @salazarm
rm all_types from config_context (#10203) by @alangenfeld
[config] memoize ConfigType snap creation (#10210) by @alangenfeld
[config] avoid double init on field cache objects (#10214) by @alangenfeld
Fix black (#10216) by @johannkm
[dagit] Invert stored state for expand/collapse in Overview pages (#10212) by @hellendag
[dagit] Updated asset details event view (#10143) by @bengotow
1.0.15 changelog (#10227) by @jamiedemaria
1.0.15 by @elementl-devtools