horovod/horovod v0.22.1

Remote filesystem support, estimator fixes

on GitHub

Added

• Estimator: added support for loading data from S3, GCS, ADLS, and other remote filesystems. (#2927)

• Estimator: added custom Spark data loader interface. (#2938)

• LightningEstimator: added support to supply a logger and associated parameter to control the frequency of logging. (#2926)

• Estimator: added check to ensure all ranks have the same device type. (#2942)

Changed

• Changed behavior from using TensorBoardLogger to now using it as a fallback if a logger is not supplied. (#2926)

• Ray: disabled capturing child tasks in placement group. (#2920)

Fixed

• Fixed hvd.tensorflow.keras.Compression, accidentally removed in v0.22.0. (#2945)

• TorchEstimator: fixed usage of validation_steps in place of validation_steps_per_epoch. (#2918)

• TensorFlow: fixed C++ API for TF v2.6.0. (#2932)

• PyTorch: fixed sparse_allreduce_async for PyTorch v0.10.0. (#2965)