astronomer/astronomer-cosmos astronomer-cosmos-v1.15.0a3

v1.15.0a3

on GitHub

Pre-release alpha of Cosmos 1.15.0.

Refresh of a2 with 28 additional milestone PRs merged since the second alpha. Headline: ExecutionMode.WATCHER and ExecutionMode.WATCHER_KUBERNETES are now stable, effective Cosmos 1.15.0 (#2865). Also includes new Behaviour changes (output-only template fields compiled_sql/freshness now raise; RenderConfig.exclude now applies to per-model/detached test tasks) and an opt-in enable_hierarchical_naming_for_group_nodes_by_folder config. The head branch was synced with main so this cut actually contains all of them. See the release PR for full provenance, the complete 162-PR changelog, and the test plan: #2810.

Now Stable

• ExecutionMode.WATCHER and ExecutionMode.WATCHER_KUBERNETES are now stable, effective Cosmos 1.15.0 (they were experimental through 1.14.x).

Behaviour Changes

• The output-only template fields compiled_sql and freshness are now rejected with CosmosValueError at task instantiation if passed via operator_args or directly to a local operator; the guard covers both the sync local operators and the async BigQuery path by @00yhj22-debug in #2726 and @qorexdevs in #2852
• RenderConfig.exclude is now applied to per-model and detached test tasks under TestBehavior.AFTER_EACH and BUILD (previously only AFTER_ALL honoured it) by @tatiana in #2850

Features

• Add an enable_hierarchical_naming_for_group_nodes_by_folder config (default False) to opt into hierarchical task-group naming for group_nodes_by_folder by @tatiana in #2862

Enhancements

• Surface dbt stdout/stderr in CosmosLoadDbtException by @DaPillah in #2826
• Avoid hard-coded watcher status strings in favour of named constants by @pankajastro in #2841

Bug Fixes

• Forward RenderConfig.exclude to per-model and detached test tasks for all test behaviours by @tatiana in #2850
• Fix group_nodes_by_folder collapsing folders that share a leaf name under different parents (opt-in via enable_hierarchical_naming_for_group_nodes_by_folder) by @anor4k in #2824
• Raise a clear exception on an empty or invalid dbt manifest instead of an opaque JSONDecodeError by @karanw330 in #2819
• Atomically update the partial_parse.msgpack cache by @mungiyo in #2815
• Fix stale context in the cached pod_manager for ExecutionMode.WATCHER_KUBERNETES by @vricciardulli in #2809
• Capture the dbt-runner error message in ExecutionMode.WATCHER consumer logs by @pankajastro in #2806
• Fix duplicate consumer logs in ExecutionMode.WATCHER mode by @pankajastro in #2805

Docs

• Add additional resources to the contributing docs by @lzdanski in #2460
• Move the GCP GKE execution modes to a dedicated documentation page by @vricciardulli in #2834
• Add a note and example for custom profile mapping by @karanw330 in #2825
• Document the self.log vs get_logger logging convention by @pankajastro in #2764
• Fix a malformed dbt-fusion docs redirect target by @pankajastro in #2849
• Mark ExecutionMode.WATCHER and ExecutionMode.WATCHER_KUBERNETES as stable (effective Cosmos 1.15.0) in the documentation by @pankajkoti in #2865

Others

• Add apache-airflow 3.3 to the test matrix by @pankajkoti in #2831
• Add a blocking lychee linkcheck CI job and fix broken docs links by @pankajastro in #2699
• Restore running integration tests on external contributors' PRs by @tatiana in #2848
• Wait for all coverage jobs before combining coverage by @pankajastro in #2842
• Dependency updates by @dependabot in #2802, #2833, #2838, #2847, #2853, and #2855

Milestone: Cosmos 1.15.0

Full changelog: astronomer-cosmos-v1.15.0a2...astronomer-cosmos-v1.15.0a3