sgl-project/sglang v0.1.13

Release v0.1.13

on GitHub

Highlights

• Gemma Support by @hnyls2002 in #256
• Add Together and AzureOpenAI examples by @merrymercy in #184

What's Changed

• correct a mistake on the README.md by @yaya-sy in #182
• correct reference dtype openai.py by @yaya-sy in #181
• Add Together and AzureOpenAI examples by @merrymercy in #184
• Fix server launch for jupyter notebook by @merrymercy in #186
• Refactor decoding logprob and add completion_tokens_wo_jump_forward by @comaniac in #189
• Pin outlines version by @comaniac in #196
• Adjust outlines version. by @hnyls2002 in #200
• Update README.md by @eltociear in #207
• Added the ability to Modify the Context Length by @psych0v0yager in #210
• Fix logprobs with logprob_start_len by @comaniac in #193
• Support outlines > 0.0.31 by @comaniac in #219
• Fix stop str merging by @hnyls2002 in #225
• Fix interpreter.py get_var(var_name) in text iter when stream is not enabled by @exceedzhang in #198
• fix chatml template by @qeternity in #195
• Upload agent_calls.jsonl download link by @hnyls2002 in #226
• Fix addr reuse in check_port by @hnyls2002 in #253
• Add SSL Cert Functionality by @nivibilla in #224
• Refactor ChatTemplate for Enhanced Clarity and Efficiency by @cubxxw in #201
• Add set_var to interpreter.py by @1024th in #263
• Add logo by @merrymercy in #275
• Fix qwen config by @hnyls2002 in #261
• replace skip_embed with input_embeds by @TideDra in #222
• Gemma Support by @hnyls2002 in #256
• Improve gemma and documentations by @merrymercy in #278
• Organize server_args by @hnyls2002 in #277
• Add Support for API Key Authentication by @alessiodallapiazza in #230
• Fix RuntimeEndpoint by @merrymercy in #279
• Update version to v0.1.13 by @merrymercy in #280

New Contributors

• @psych0v0yager made their first contribution in #210
• @exceedzhang made their first contribution in #198
• @qeternity made their first contribution in #195
• @cubxxw made their first contribution in #201
• @1024th made their first contribution in #263
• @TideDra made their first contribution in #222
• @alessiodallapiazza made their first contribution in #230

Full Changelog: v0.1.12...v0.1.13