github spotify/luigi 3.1.0

latest releases: v3.5.2, 3.5.1, 3.5.0...
2 years ago

3.1.0

Added

luigi

  • Documentation guidance around release version increments #3074
  • Add support for naming tasks in @requires #3077
  • Add traceback_max_length parameter for error email notifications #3086
  • Document cause of Unfulfilled dependency error #3105
  • Add additional OptionalParameter datatype options #3079
  • UI: Add rerun command snippet on "show error" modal #3117
  • Add support for updating default config parser after loading luigi #3135
  • Allow batch_email.email_interval to be set in config as email-internal-minutes #3125
  • Allow TimeDeltaParameter to accept input as "seconds" #3125
  • Add EnumListParameter to top-level attribute imports #3144
  • Enable metrics_custom_import for MetricCollectors #3146
  • Improve warning when a parameter is not consumed by a task #3170

luigi.contrib

  • Add configure_job BigQuery property #3098
  • Add parquet support to BigQuery #3099
  • Add network retry logic to BigQuery #3088
  • Add run_task_kwargs property to ECS #3083
  • Add pickle_protocol attribute and configuration option to Spark #3001
  • Add pg8000 driver support to Postgres #3142

Fixed

luigi

  • Fix default value for task.disable_window #3081
  • Fix deconstructor of LocalTarget when is_tmp attribute dne #3085
  • Improved documentation reference to luigi.format.Nop import #3047
  • Fix Python 3.10 deprecation warnings #3150
  • Remove unnecessary extra call to cls.get_task_namespace() #3129
  • Fix documentation typo in notifications_test.py #3151
  • Fix docs ci #3158
  • Fix task history rendering #3153
  • Move max_shown_tasks and max_graph_nodes documentation to correct section #3156
  • Fix ability to subclass Task's Register metaclass #3154
  • Replace legacy TravicCI readme badge with GithubActions #3159

luigi.contrib

  • Fix apache ci
  • Fix documentation typo in sqla #3110
  • Fix spark cluster mode error for missing path #3111
  • Fix connection object passed to rdbms.CopyToTable's _add_metadata_columns() #3011

Removed

luigi

  • Remove @Tarrasch from codeowners #3127

Changed

luigi

  • Update license copyright year #3108
  • Improve error message on parsing default parameter value #3115
  • Group tasks by task class in svg graph #3122
  • Upgrade tenacity version #3147
  • Enable task search to be case insensitive #3157

luigi.contrib

  • Update ExternalPythonProgramTask parameters to OptionalParameter #3130
  • Allow newer versions of prometheus-client package #3163

Don't miss a new luigi release

NewReleases is sending notifications on new releases.