astronomer/astronomer-cosmos astronomer-cosmos-v1.9.0 on GitHub

Breaking changes

When using LoadMode.DBT_LS, Cosmos will now attempt to use the dbtRunner as opposed to subprocess to run dbt ls.
While this represents significant performance improvements (half the vCPU usage and some memory consumption improvement), this may not work in
scenarios where users had multiple Python virtual environments to manage different versions of dbt and its adaptors. In those cases,
please, set RenderConfig(invocation_mode=InvocationMode.SUBPROCESS) to have the same behaviour Cosmos had in previous versions.
Additional information here <https://astronomer.github.io/astronomer-cosmos/configuration/parsing-methods.html#dbt-ls>_ and here <https://astronomer.github.io/astronomer-cosmos/configuration/render-config.html#how-to-run-dbt-ls-invocation-mode>_.

Features

Use dbtRunner in the DAG Processor when using LoadMode.DBT_LS if dbt-core is available by @tatiana in #1484. Additional information here <https://astronomer.github.io/astronomer-cosmos/configuration/parsing-methods.html#dbt-ls>_.
Allow users to opt-out of dbtRunner during DAG parsing with InvocationMode.SUBPROCESS by @tatiana in #1495. Check out the documentation <https://astronomer.github.io/astronomer-cosmos/configuration/render-config.html#how-to-run-dbt-ls-invocation-mode>_.
Add structure to support multiple db for async operator execution by @pankajastro in #1483
Support overriding the profile_config per dbt node or folder using config by @tatiana in #1492. More information here <https://astronomer.github.io/astronomer-cosmos/profiles/#profile-customise-per-node>_.
Create and run accurate SQL statements when using ExecutionMode.AIRFLOW_ASYNC by @pankajkoti, @tatiana and @pankajastro in #1474
Add AWS ECS task run execution mode by @CarlosGitto and @aoelvp94 in #1507
Add support for running DbtSourceOperator individually by @victormacaubas in #1510
Add setup task for async executions by @pankajastro in #1518
Add teardown task for async executions by @pankajastro in #1529
Add ProjectConfig.install_dbt_deps & change operator install_deps=True as default by @tatiana in #1521
Extend Virtualenv operator and mock dbt adapters for setup & teardown tasks in ExecutionMode.AIRFLOW_ASYNC by @pankajkoti, @tatiana and @pankajastro in #1544

Bug Fixes

Fix select complex intersection of three tag-based graph selectors by @tatiana in #1466
Fix custom selector behaviour when the model name contains periods by @yakovlevvs and @60098727 in #1499
Filter dbt and non-dbt kwargs correctly for async operator by @pankajastro in #1526

Enhancement

Fix OpenLineage deprecation warning by @CorsettiS in #1449
Move DbtRunner related functions into dbt/runner.py module by @tatiana in #1480
Add on_warning_callback to DbtSourceKubernetesOperator and refactor previous operators by @LuigiCerone in #1501
Gracefully error when users set incompatible RenderConfig.dbt_deps and operator_args install_deps by @tatiana in #1505
Store compiled SQL as template field for ExecutionMode.AIRFLOW_ASYNC by @pankajkoti in #1534

Docs

Improve RenderConfig arguments documentation by @tatiana in #1514
Improve callback documentation by @tatiana in #1516
Improve partial parsing docs by @tatiana in #1520
Fix typo in selecting & excluding docs by @pankajastro in #1523
Document async_py_requirements added in ExecutionConfig for ExecutionMode.AIRFLOW_ASYNC by @pankajkoti in #1545

Others

astronomer/astronomer-cosmos astronomer-cosmos-v1.9.0 v1.9.0 on GitHub