Phi 3.5 is here!
Try it out here: https://colab.research.google.com/drive/1lN6hPQveB_mHSnTOYifygFcrO8C1bxq4?usp=sharing
What's Changed
- Llama 3.1 by @danielhanchen in #797
- Better debugging by @danielhanchen in #826
- fix UnboundLocalError by @xyangk in #834
- Gemma by @danielhanchen in #843
- Fix ROPE extension issue and device mismatch by @xyangk in #840
- Fix RoPE extension by @danielhanchen in #846
- fix: fix config.torch_dtype bug by @relic-yuexi in #874
- pascal support by @emuchogu in #870
- Fix tokenizers by @danielhanchen in #887
- Torch 2.4, Xformers>0.0.27, TRL>0.9, Python 3.12 + bug fixes by @danielhanchen in #902
- Fix DPO stats by @danielhanchen in #906
- Fix Chat Templates by @danielhanchen in #916
- Fix chat templates by @danielhanchen in #917
- Bug Fixes by @danielhanchen in #920
- Fix mapping by @danielhanchen in #921
- untrained tokens llama 3.1 base by @danielhanchen in #929
- Bug #930 by @danielhanchen in #931
- Fix NEFTune by @danielhanchen in #937
- Update README.md by @danielhanchen in #938
New Contributors
- @relic-yuexi made their first contribution in #874
- @emuchogu made their first contribution in #870
Full Changelog: July-Mistral-2024...August-2024