Added
luigi:
- Add a configuration parameter to force multiprocessing (#2401)
- Add a configuration parameter to enable/disable the pause button (#2399)
- Send messages from scheduler to tasks (via "Send message" UI button) (#2426)
- Allow to inject a context manager around
TaskProcess.run
(viatask_process_context
configuration parameter) (#2449)
luigi.contrib:
- S3: use Boto3 for the
S3Client
(#2423, #2149) - GCS: add method to push files using multiprocessing (#2376)
- HDFS: add
get_merge
to snakebite client (#2410) - Redshift: add schema to DB if it doesn't exist (#2439)
- Redshift: add table constraints support (#2435)
Fixed
luigi:
- Allow long parameters in task history DB SQL result store (#2404)
- Fix
MissingParameterException
when generating execution summary (#2415) - Fix luigid crash due to configuration file parsing (#2394)
- Allow explicit parsing of
BoolParameters
(vialuigi.BoolParameter.parsing
variable) (#2427) - Make
ChoiceParameter
check if option is valid within.normalize
(#2454) - ...and a good deal of documentation fixes and similar.