What's Changed
- Switch Tuning database to SQLite3 for Incremental Tuning
- Add matrix bias to forward/backward kernel
- Fix build failures due to missing
- Add new triton kernel debug_fill_dropout_rng to for debugging dropout
- Add FP32 support to fulfill the functionalities required by
torch.nn.attention.SDPBackend.EFFICIENT_ATTENTION
Notes about binary delivery
Starting from 0.5 Beta, we are not delivering binary form of AOTriton along with software releases due to software supply chain security considerations, for now.
Full Changelog: 0.4.1b...0.5b