What's Changed
Key Features：
Ahead of the official v0.2.4 release, we're excited to announce the preliminary ROCm support for ktransformers in response to strong community demand. This update delivers enhanced heterogeneous computing capabilities for developers utilizing AMD GPUs. #178
Extended our heartfelt gratitude to contributor @fxzjshm! Your profound technical expertise demonstrated in the ROCm adaptation work has been instrumental in achieving framework compatibility. Also, we would like to thank the AMD team for their technology and equipment support.
Other Updates:
- fix #829: support older AVX512-capable CPUs by @isxylands in #847
- Update install.md by @flappyknight in #880
- cpuinfer: filter repeated backend instantiation by @Lander-Hatsune in #852
- fix-singleton by @Atream in #886
- use compile for gate, slight performance improvement by @Atream in #891
- Add Unit Test for Local Chat by @SkqLiao in #897
New Contributors
- @isxylands made their first contribution in #847
- @flappyknight made their first contribution in #880
- @Lander-Hatsune made their first contribution in #852
- @fxzjshm made their first contribution in #178
Full Changelog: v0.2.3post1...v0.2.3post2