pypi accelerate 0.15.0
v0.15.0: Pytorch 2.0 stack support

latest releases: 1.1.1, 1.1.0, 1.0.1...
23 months ago

PyTorch 2.0 stack support

We are very excited by the newly announced PyTorch 2.0 stack and you can try it using Accelerate on any model by using the dynamo_backend argument of the Accelerator, or when filling your config with accelerate config.

Note that to get the best performance, we recommend:

  • using an Ampere GPU (or more recent)
  • sticking to fixed shaped for now

New CLI commands

  • Added two new commands, accelerate config update and accelerate config default. The first will update a config file to have the latest keys added from latter releases of Accelerate, and the second will create a default configuration file automatically mimicking write_default_config() introduced in #851 and #853 by @muellerzr
  • Also introduced a filterable help for accelerate launch which will show options relevant to the choices shown, such as accelerate launch --multi_gpu will show launch parameters relevant to multi-gpu training.

What's new?

Significant community contributions

The following contributors have made significant changes to the library over the last release:

Don't miss a new accelerate release

NewReleases is sending notifications on new releases.