v1.5.0 is a huge release. Tons of important features.
Make sure to run airflow upgradedb after you upgrade
Improvements:
- @jlowin landed a feature to communicate information across tasks called XCom, more information here
- @neovintage integrated Airflow with Alembic, making database migration easy, run
airflow upgradedbto get your database up to date as you upgrade Airflow - The dependency engine is now more flexible, allowing for trigger rules, before this update, tasks would only be triggered when all dependencies were successful (still the default), now you can set tasks to trigger when a single parent succeeds, when one fails, when they all fail, or to fire regardless of their dependencies:
- @neovintage added support for connection to be defined in environment variables, allowing to bypass or override the metadata database
- @jlowin improved the tree view to render a non expendable when trees go above 5k nodes
- The Druid hook and HiveToDruidTransfer are maturing and becoming production grade
- @kapil-malik added a UI feature where some users can only see their own DAGs while superusers can still see all, this feature is turned off by default
- Allowing all operators and some preoperators to receive list of sql statements to be execute as a chain
- Improved the task_instance table to log the operator name and queued timestamp
- Passwords in the metadata can now be encrypted
- Improvements to the unit tests (speed + coverage)
- Bugfixes + more