github ROCm/aotriton 0.8.2b
AOTriton 0.8.2 Beta

latest releases: 0.12.1b, 0.12.50tp2, 0.12.50tp...
17 months ago

0.8.2b is an emergency fix

We received reports there is a bug causing NaN during fine-tuning llama3.2-11b vision model. Anyone who uses 0.8 is recommended to upgrade to 0.8.2b.

Note: AOTriton 0.8.1b adds head dimension 512 support and thus the binary size increases compared with 0.8b

This is a point release

0.8.2b can be used as drop-in replacement of 0.8b shared object file.

What's Changed

  • Fix missing batch_index when calculating bias pointer by @xinyazhang in #68

Full Changelog: 0.8.1b...0.8.2b

Don't miss a new aotriton release

NewReleases is sending notifications on new releases.