apache-airflow 1.10.8

Airflow 1.10.8, 2020-02-07

on Python PyPI

New Features

• [AIRFLOW-4026] Add filter by DAG tags (#6489)
• [AIRFLOW-6613] Center dag on graph view load (#7238)
• [AIRFLOW-5843] Add conf option to Add DAG Run view (#7281)
• [AIRFLOW-4495] Allow externally triggered dags to run for future exec dates (#7038)

Improvements

• [AIRFLOW-6438] Filter DAGs returned by blocked (#7019)
• [AIRFLOW-6666] Resolve js-yaml advisory (#7283)
• [AIRFLOW-6632] Bump dagre-d3 to resolve lodash CVE advisory (#7280)
• [AIRFLOW-6667] Resolve serialize-javascript advisory (#7282)
• [AIRFLOW-6451] self._print_stat() in dag_processing.py should be skippable (#7134)
• [AIRFLOW-6495] Load DAG only once when running a task using StandardTaskRunner (#7090)
• [AIRFLOW-6319] Add support for AWS Athena workgroups (#6871)
• [AIRFLOW-6677] Remove deprecation warning from SQLAlchmey (#7289)
• [AIRFLOW-6428] Fix import path for airflow.utils.dates.days_ago in Example DAGs (#7007)
• [AIRFLOW-6595] Use TaskNotFound exception instead of AirflowException (#7210)
• [AIRFLOW-6620] Mock celery in worker cli test (#7243)
• [AIRFLOW-6608] Change logging level for Bash & PyOperator Env exports
• [AIRFLOW-2279] Clear tasks across DAGs if marked by ExternalTaskMarker (#6633)
• [AIRFLOW-6359] Make Spark status_poll_interval explicit (#6978)
• [AIRFLOW-6359] spark_submit_hook.py status polling interval config (#6909)
• [AIRFLOW-6316] Use exampleinclude directives in tutorial.rst (#6868)
• [AIRFLOW-6519] Make TI logs constants in Webserver configurable (#7113)
• [AIRFLOW-6327] http_hook: Accept json= parameter for payload (#6886)
• [AIRFLOW-6261] flower_basic_auth eligible to _cmd (#6825)
• [AIRFLOW-6238] Filter dags returned by dag_stats
• [AIRFLOW-5616] Switch PrestoHook from pyhive to prestosql-client to s
• [AIRFLOW-6611] Add proxy_fix configs to default_airflow.cfg (#7236)
• [AIRFLOW-6557] Add test for newly added fields in BaseOperator (#7162)
• [AIRFLOW-6584] Pin cassandra driver (#7194)
• [AIRFLOW-6537] Fix backticks in rst files (#7140)
• [AIRFLOW-4428] Error if exec_date before default_args.start_date in trigger_dag (#6948)
• [AIRFLOW-6330] Show cli help when param blank or typo (#6883)
• [AIRFLOW-4113] Unpin boto3 (#6884)
• [AIRFLOW-6181] Add DebugExecutor (#6740)
• [AIRFLOW-6504] Allow specifying configmap for Airflow Local Setting (#7097)
• [AIRFLOW-6436] Cleanup for Airflow configs doc generator code (#7036)
• [AIRFLOW-6436] Add x_frame_enabled config in config.yml (#7024)
• [AIRFLOW-6436] Create & Automate docs on Airflow Configs (#7015)
• [AIRFLOW-6527] Make send_task_to_executor timeout configurable (#7143)
• [AIRFLOW-6272] Switch from npm to yarnpkg for managing front-end dependencies (#6844)
• [AIRFLOW-6350] Security - spark submit operator logging+exceptions should mask passwords
• [AIRFLOW-6358] Log details of failed task (#6908)
• [AIRFLOW-5149] Skip SLA checks config (#6923)
• [AIRFLOW-6057] Update template_fields of the PythonSensor (#6656)
• [AIRFLOW-4445] Mushroom cloud errors too verbose (#6952)
• [AIRFLOW-6394] Simplify github PR template (#6955)
• [AIRFLOW-5385] spark hook does not work on spark 2.3/2.4 (#6976)

Bug Fixes

• [AIRFLOW-6345] Ensure arguments to ProxyFix are integers (#6901)
• [AIRFLOW-6576] Fix scheduler crash caused by deleted task with sla misses (#7187)
• [AIRFLOW-6686] Fix syntax error constructing list of process ids (#7298)
• [AIRFLOW-6683] REST API respects store_serialized_dag setting (#7296)
• [AIRFLOW-6553] Add upstream_failed in instance state filter to WebUI (#7159)
• [AIRFLOW-6357] Highlight nodes in Graph UI if task id contains dots (#6904)
• [AIRFLOW-3349] Use None instead of False as value for encoding in StreamLogWriter (#7329)
• [AIRFLOW-6627] Email with incorrect DAG not delivered (#7250)
• [AIRFLOW-6637] Fix airflow test command in 1.10.x
• [AIRFLOW-6636] Avoid exceptions when printing task instance
• [AIRFLOW-6522] Clear task log file before starting to fix duplication in S3TaskHandler (#7120)
• [AIRFLOW-5501] Make default in_cluster value in KubernetesPodOperator respect config (#6124)
• [AIRFLOW-6514] Use RUNNING_DEPS to check run from UI (#6367)
• [AIRFLOW-6381] Remove styling based on DAG id from DAGs page (#6985)
• [AIRFLOW-6434] Add return statement back to DockerOperator.execute (#7013)
• [AIRFLOW-2516] Fix mysql deadlocks (#6988)
• [AIRFLOW-6528] Disable flake8 W503 line break before binary operator (#7124)
• [AIRFLOW-6517] Make merge_dicts function recursive (#7111)
• [AIRFLOW-5621] Failure callback is not triggered when marked Failed on UI (#7025)
• [AIRFLOW-6353] Security - ui - add click jacking defence (#6995)
• [AIRFLOW-6348] Security - cli.py is currently printing logs with password (#6915)
• [AIRFLOW-6323] Remove non-ascii letters from default config (#6878)
• [AIRFLOW-6506] Fix do_xcom_push defaulting to True in KubernetesPodOperator (#7122)
• [AIRFLOW-6516] BugFix: airflow.cfg does not exist in Volume Mounts (#7109)
• [AIRFLOW-6427] Fix broken example_qubole_operator dag (#7005)
• [AIRFLOW-6385] BugFix: SlackAPIPostOperator fails when blocks not set (#7022)
• [AIRFLOW-6347] BugFix: Can't get task logs when serialization is enabled (#7092)
• [AIRFLOW-XXXX] Fix downgrade of db migration 0e2a74e0fc9f (#6859)
• [AIRFLOW-6366] Fix migrations for MS SQL Server (#6920)
• [AIRFLOW-5406] Allow spark without kubernetes (#6921)
• [AIRFLOW-6229] SparkSubmitOperator polls forever if status json can't… (#6918)
• [AIRFLOW-6352] Security - ui - add login timeout (#6912)
• [AIRFLOW-6397] Ensure sub_process attribute exists before trying to kill it (#6958)
• [AIRFLOW-6400] Fix pytest not working on Windows (#6964)
• [AIRFLOW-6418] Remove SystemTest.skip decorator (#6991)
• [AIRFLOW-6425] Serialization: Add missing DAG parameters to Json Schema (#7002)

Misc/Internal

• [AIRFLOW-6467] Use self.dag i/o creating a new one (#7067)
• [AIRFLOW-6490] Improve time delta comparison in local task job tests (#7083)
• [AIRFLOW-5814] Implementing Presto hook tests (#6491)
• [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing (#6516)
• [AIRFLOW-XXXX] Move airflow-config-yaml pre-commit before pylint (#7108)
• [AIRFLOW-XXXX] Improve clarity of confirm message (#7110)
• [AIRFLOW-6662] install dumb init (#7300)
• [AIRFLOW-6705] One less chatty message at breeze initialisation (#7326)
• [AIRFLOW-6705] Less chatty integration/backend checks (#7325)
• [AIRFLOW-6662] Switch to --init docker flag for signal propagation (#7278)
• [AIRFLOW-6661] Fail after 50 failing tests (#7277)
• [AIRFLOW-6607] Get rid of old local scripts for Breeze (#7225)
• [AIRFLOW-6589] BAT tests run in pre-commit on bash script changes (#7203)
• [AIRFLOW-6592] Doc build is moved to test phase (#7208)
• [AIRFLOW-6641] Better diagnostics for kubernetes flaky tests (#7261)
• [AIRFLOW-6642] Make local task job test less flaky (#7262)
• [AIRFLOW-6643] Fix flakiness of kerberos tests
• [AIRFLOW-6638] Remove flakiness test from test_serialized_db remove
• [AIRFLOW-6701] Rat is downloaded from stable backup/mirrors (#7323)
• [AIRFLOW-6702] Dumping kind logs to file.io. (#7319)
• [AIRFLOW-6491] Improve handling of Breeze parameters (#7084)
• [AIRFLOW-6470] Avoid pipe to file when do curl (#7063)
• [AIRFLOW-6471] Add pytest-instafail plugin (#7064)
• [AIRFLOW-6462] Limit exported variables in Dockerfile/Breeze (#7057)
• [AIRFLOW-6465] Add bash autocomplete for airflow in Breeze (#7060)
• [AIRFLOW-6464] Add cloud providers CLI tools in Breeze (#7059)
• [AIRFLOW-6461] Remove silent flags in Dockerfile (#7052)
• [AIRFLOW-6459] Increase verbosity of pytest (#7049)
• [AIRFLOW-6370] Skip Cassandra tests if cluster is not up (#6926)
• [AIRFLOW-6511] Remove BATS docker containers (#7103)
• [AIRFLOW-6475] Remove duplication of volume mount specs in Breeze.. (#7065)
• [AIRFLOW-6489] Add BATS support for Bash unit testing (#7081)
• [AIRFLOW-6387] print details of success/skipped task (#6956)
• [AIRFLOW-6568] Add Emacs related files to .gitignore (#7175)
• [AIRFLOW-6575] Entropy source for CI tests is changed to unblocking (#7185)
• [AIRFLOW-6496] Separate integrations in tests (#7091)
• [AIRFLOW-6634] Set PYTHONPATH in interactive Breeze
• [AIRFLOW-6564] Additional diagnostics information on CI check failure (#7172)
• [AIRFLOW-6383] Add no trailing-whitespace pre-commit hook (#6941)

Doc only changes

• [AIRFLOW-XXXX] Consistency fixes in new documentation (#7207)
• [AIRFLOW-XXXX] Improve grammar and structure in FAQ doc (#7291)
• [AIRFLOW-XXXX] Fix email configuration link in CONTRIBUTING.rst (#7311)
• [AIRFLOW-XXXX] Update docs with new BranchPythonOperator behaviour (#4682)
• [AIRFLOW-XXXX] Fix Typo in scripts/ci/ci_run_airflow_testing.sh (#7235)
• [AIRFLOW-XXXX] Screenshot showing disk space configuration for OSX (#7226)
• [AIRFLOW-XXXX] Add mentoring information to contributing docs (#7202)
• [AIRFLOW-XXXX] Add rebase info to contributing (#7201)
• [AIRFLOW-XXXX] Increase verbosity of static checks in CI (#7200)
• [AIRFLOW-XXXX] Adds branching strategy to documentation (#7193)
• [AIRFLOW-XXXX] Move email configuration from the concept page (#7189)
• [AIRFLOW-XXXX] Update task lifecycle diagram (#7161)
• [AIRFLOW-XXXX] Fix reference in concepts doc (#7135)
• [AIRFLOW-XXXX] Clear debug docs (#7104)
• [AIRFLOW-XXXX] Fix typos and broken links in development docs (#7086)
• [AIRFLOW-XXXX] Clarify wait_for_downstream and execution_date (#6999)
• [AIRFLOW-XXXX] Add airflow dags show command guide (#7014)
• [AIRFLOW-XXXX] Update operation chaining documentation (#7018)
• [AIRFLOW-XXXX] Add .autoenv_leave.zsh to .gitignore (#6986)
• [AIRFLOW-XXXX] Fix development packages installation instructions (#6942)
• [AIRFLOW-XXXX] Update committers list (#7212)
• [AIRFLOW-XXXX] Move UPDATING changes into correct versions (#7166)
• [AIRFLOW-XXXX] Add Documentation for check_slas flag (#6974)
• [AIRFLOW-XXXX] Fix gcp keyfile_dict typo (#6962)
• [AIRFLOW-XXXX] Add tips for writing a note in UPDATIND.md (#6960)
• [AIRFLOW-XXXX] Add note warning that bash>4.0 is required for docs build script (#6947)
• [AIRFLOW-XXXX] Add autoenv to gitignore (#6946)
• [AIRFLOW-XXXX] Fix GCSTaskHandler Comment Typo (#6928)
• [AIRFLOW-XXXX] Fix broken DAG Serialization Link (#6891)
• [AIRFLOW-XXXX] Add versions_added field to configs