pypi apache-airflow 2.10.5
Apache Airflow 2.10.5

2 days ago

Significant Changes

Ensure teardown tasks are executed when DAG run is set to failed (#45530)

Previously when a DAG run was manually set to "failed" or to "success" state the terminal state was set to all tasks.
But this was a gap for cases when setup- and teardown tasks were defined: If teardown was used to clean-up infrastructure
or other resources, they were also skipped and thus resources could stay allocated.

As of now when setup tasks had been executed before and the DAG is manually set to "failed" or "success" then teardown
tasks are executed. Teardown tasks are skipped if the setup was also skipped.

As a side effect this means if the DAG contains teardown tasks, then the manual marking of DAG as "failed" or "success"
will need to keep the DAG in running state to ensure that teardown tasks will be scheduled. They would not be scheduled
if the DAG is directly set to "failed" or "success".

Bug Fixes

  • Prevent using trigger_rule=TriggerRule.ALWAYS in a task-generated mapping within bare tasks (#44751)
  • Fix ShortCircuitOperator mapped tasks (#44912)
  • Fix premature evaluation of tasks with certain trigger rules (e.g. ONE_DONE) in a mapped task group (#44937)
  • Fix task_id validation in BaseOperator (#44938) (#44938)
  • Allow fetching XCom with forward slash from the API and escape it in the UI (#45134)
  • Fix FileTaskHandler only read from default executor (#46000)
  • Fix empty task instance for log (#45702) (#45703)
  • Remove skip_if and run_if decorators before TaskFlow virtualenv tasks are run (#41832) (#45680)
  • Fix request body for json requests in event log (#45546) (#45560)
  • Ensure teardown tasks are executed when DAG run is set to failed (#45530) (#45581)
  • Do not update DR on TI update after task execution (#45348)
  • Fix object and array DAG params that have a None default (#45313) (#45315)
  • Fix endless sensor rescheduling (#45224) (#45250)
  • Evaluate None in SQLAlchemy's extended JSON type decorator (#45119) (#45120)
  • Allow dynamic tasks to be filtered by rendered_map_index (#45109) (#45122)
  • Handle relative paths when sanitizing URLs (#41995) (#45080)
  • Set Autocomplete Off on Login Form (#44929) (#44940)
  • Add Webserver parameters max_form_parts, max_form_memory_size (#46243) (#45749)
  • Fixed accessing thread local variable in BaseOperators execute safeguard mechanism (#44646) (#46280)
  • Add map_index parameter to extra links API (#46337)

Miscellaneous

  • Add traceback log output when SIGTERMs was sent (#44880) (#45077)
  • Removed the ability for Operators to specify their own "scheduling deps" (#45713) (#45742)
  • Deprecate conf from Task Context (#44993)

Don't miss a new apache-airflow release

NewReleases is sending notifications on new releases.