astronomer/astronomer-cosmos astronomer-cosmos-v.1.11.0a6

v1.11.0a6

on GitHub

Features

• Introduce ExecutionMode.WATCHER to reduce DAG run time by 1/5 in several PRs, including:
  • Expose new execution mode by @tatiana @pankajastro @pankajkoti in #1999
  • Add DbtProducerWatcherOperator for the proposed ExecutionMode.WATCHER by @pankajkoti in #1982
  • Add DbtConsumerWatcherSensor for the proposed ExecutionMode.WATCHER by @pankajastro in #1998
  • Push producer's task completion status to XCOM by @pankajkoti in #2000
  • Add default priority_weight for DbtProducerWatcherOperator by @pankajkoti in #1995
  • Add sample dbt events for the dbt watcher execution mode by @pankajkoti in #1952
• Initial support to dbt Fusion by @tatiana in #1803. More details here. <https://astronomer.github.io/astronomer-cosmos/configuration/dbt-fusion>_.
• Support to prune sources without downstream references in dbt projects by @corsettigyg in #1988
• Allow to set task display name as a user-defined function by @corsettigyg in #1761
• Add dbt project's hash to dag docs to support dag versioning in Airflow 3 by @pankajkoti in #1907
• feat: Add Jinja templating support for dbt_cmd_flags by @skillicinski in #1899
• Add Scarf metric to collect the execution mode uses by @pankajastro in #1981

Enhancement

• Use XCom to store sql when using ExecutionMode.AIRFLOW_ASYNC by @pankajastro in #1934
• Refactor AIRFLOW_ASYNC teardown so it doesn't install the virtualenv by @pankajastro in #1938
• Reuse the virtual env for AIRFLOW_ASYNC setup task by @pankajastro in #1939

Bug fixes

• Fix tags extraction by @ms32035 in #1915

Documentation

• Add Cosmos Deferrable Operator Guide by @pankajastro in #1922
• Add dbt Fusion documentation by @tatiana in #1824 #1830
• Update dbt-fusion.rst to explicitly highlight it is in alpha by @tatiana in #1838
• Fix a bunch of docs build errors and warnings by @pankajkoti in #1886
• Add docs note for param virtualenv_dir for async execution mode by @pankajastro in #1969
• Use pepy.tech downloads badge in README by @pankajkoti in #1920

Others

• Promote @corsettigyg to committer by @tatiana in #1985
• Add @pankajkoti and @pankajastro to contributors.rst by @tatiana in #1983
• Fix failing dbt Fusion tests when run in parallel in CI by @pankajkoti in #1896
• Fix MyPy issues related to ObjectStoragePath in main branch by @tatiana in #2012
• Cleanup example dbt event JSON dictionaries kept for XCOM reference by @pankajkoti in #1997
• Bump min hatch version that includes fixes for click>=8.3.0 by @pankajkoti in #1996
• Use official Postgres image from Docker hub for Kubernetes setup by @pankajkoti in #1986
• Use click<8.3.0 for hatch as click 8.3 breaks hatch by @pankajkoti in #1987
• Pin Airflow version in type check CI job by @pankajastro in #2003
• Improve comments after feedback on #1948 by @tatiana in #1963
• Fix running tests with dbt Fusion 2.0.0 preview versions by @tatiana in #1948
• Test hardening of dbt node having tags as unset or missing by @pankajkoti in #1918
• pre-commit autoupdate in #1990, #2019, #2008, #1941, #1935, #1924
• GitHub dependabot update in #1947, #1955, #1946, #1944, #1945, #1928 #1921 #1917