What's Changed
- add dolphin by @infwinston in #2794
- Fix tiny typo by @bofenghuang in #2805
- Add instructions for evaluating on MT bench using vLLM by @iojw in #2770
- fix missing op | for py3.8 by @dumpmemory in #2800
- Add SOLAR-10.7b Instruct Model by @BabyChouSr in #2826
- Update README.md by @eltociear in #2852
- fix: 'compeletion' typo by @congchan in #2847
- Add Tunnelmole as an open source alternative to ngrok and include usage instructions by @robbie-cahill in #2846
- Add support for CatPPT by @rishiraj in #2840
- Add functionality to ping AI2 InferD endpoints for tulu 2 by @natolambert in #2832
- add download models from www.modelscope.cn by @liuyhwangyh in #2830
- Fix conv_template of chinese alpaca 2 by @zollty in #2812
- add bagel model adapter by @jondurbin in #2814
- add root_path argument to gradio web server. by @stephanbertl in #2807
- Import
acceleratelocally to avoid it as a strong dependency by @chiragjn in #2820 - Replace dict merge with unpacking for compatibility of 3.8 in vLLM worker by @rudeigerc in #2824
- Format code by @merrymercy in #2854
- Openai API migrate by @andy-yang-1 in #2765
- Add new models (Perplexity, gemini) & Separate GPT versions by @merrymercy in #2856
- Clean error messages by @merrymercy in #2857
- Update docs by @Ying1123 in #2858
- Modify doc description by @zhangsibo1129 in #2859
- Fix the problem of not using the decoding method corresponding to the base model in peft mode by @Jingsong-Yan in #2865
- update a new sota model on MT-Bench which touch an 8.8 scores. by @xiechengmude in #2864
- NPU needs to be initialized when starting a new process by @jq460494839 in #2843
- Fix the problem with "vllm + chatglm3" (#2845) by @yaofeng in #2876
- Update token spacing for mistral conversation.py by @thavens in #2872
- check if hm in models before deleting to avoid errors by @joshua-ne in #2870
- Add TinyLlama by @Gk-rohan in #2889
- Fix bug that model doesn't automatically switch peft adapter by @Jingsong-Yan in #2884
- Update web server commands by @merrymercy in #2869
- fix the tokenize process and prompt template of chatglm3 by @WHDY in #2883
- Add
Notussupport by @gabrielmbmb in #2813 - feat: support anthropic api with api_dict by @congchan in #2879
- Update model_adapter.py by @thavens in #2895
- leaderboard code update by @infwinston in #2867
- fix: change order of SEQUENCE_LENGTH_KEYS by @congchan in #2925
- fix baichuan:apply_prompt_template call args error by @Force1ess in #2921
- Fix a typo in openai_api_server.py by @jklj077 in #2905
- feat: use variables OPENAI_MODEL_LIST by @congchan in #2907
- Add TenyxChat-7B-v1 model by @sarath-shekkizhar in #2901
- add support for iei yuan2.0 (https://huggingface.co/IEITYuan) by @wangpengfei1013 in #2919
- nous-hermes-2-mixtral-dpo by @152334H in #2922
- Bump the version to 0.2.35 by @merrymercy in #2927
New Contributors
- @dumpmemory made their first contribution in #2800
- @robbie-cahill made their first contribution in #2846
- @rishiraj made their first contribution in #2840
- @natolambert made their first contribution in #2832
- @liuyhwangyh made their first contribution in #2830
- @stephanbertl made their first contribution in #2807
- @chiragjn made their first contribution in #2820
- @rudeigerc made their first contribution in #2824
- @jq460494839 made their first contribution in #2843
- @yaofeng made their first contribution in #2876
- @thavens made their first contribution in #2872
- @joshua-ne made their first contribution in #2870
- @WHDY made their first contribution in #2883
- @gabrielmbmb made their first contribution in #2813
- @jklj077 made their first contribution in #2905
- @sarath-shekkizhar made their first contribution in #2901
- @wangpengfei1013 made their first contribution in #2919
Full Changelog: v0.2.34...v0.2.35