- Local mode is now powered by LM Studio. Running
--localwill tell you how to setup LM Studio + connect to it automatically. - It's way smaller. Removed the MASSIVE local embedding model, chromadb, oobabooga, a bunch of other packages we didn't really need. Semgrep is now optional.
- The system message is tighter, so it's cheaper + faster on any LLM.
Several crashes have also been resolved, temperature is now properly set to 0 (which should increase performance on OpenAI models), Powershell on Linux support, an ugly print statement was removed, we're now enforcing a consistent code style (black, isort), and much more:
What's Changed
- Fix a crash in get_relevant_procedures_string by @Notnaton in #676
- Fixed issue with 3.5 Models hallucinating a function called "python", causing empty returns by @Cobular in #683
- Fixed Issue #661 by @shubhexists in #687
- Consider hiding the api-key by @Notnaton in #682
- Remove space from language by @Notnaton in #680
- Update README.md by @Shivam250702 in #677
- docs: fix typo in docs/WINDOWS.md by @suravshresth in #658
- Update MACOS.md by @ihgalis in #471
- Update README.md with ref to MACOS.md by @ihgalis in #472
- Clarity updates to README.md by @shruti222patel in #674
- fix: make sure safe_mode is disabled by default by @ericrallen in #705
- Update README.md to say Mistral 7B by @Maclean-D in #690
- fix: default to 0 if temperature is unset by @ericrallen in #710
- chore: add better docs for safe_mode; load semgrep if available by @ericrallen in #709
- chore: remove extraneous chroma package; clean up dependency list by @ericrallen in #704
- fix: make all local models run through the html entity buffer by @ericrallen in #703
- Fix GNU readline support for user input by @cowile in #522
- docs: fix markdown formatting; better explain %tokens by @ericrallen in #695
- fix: clarify that %tokens estimates token usage for next request by @ericrallen in #694
- Proposal: Enforce consistent code style with black, isort, and pre-commit by @ericrallen in #699
- Fix for failing Powershell code execution on Linux by @thefazzer in #729
- Update README.md for sample FastAPI by @AndrewNgo-ini in #727
- Update MACOS.md: fix command by @pjpjq in #725
- update Readme_ZH.md by @HashCookie in #712
New Contributors
- @Notnaton made their first contribution in #676
- @Cobular made their first contribution in #683
- @shubhexists made their first contribution in #687
- @Shivam250702 made their first contribution in #677
- @suravshresth made their first contribution in #658
- @shruti222patel made their first contribution in #674
- @cowile made their first contribution in #522
- @thefazzer made their first contribution in #729
- @AndrewNgo-ini made their first contribution in #727
- @pjpjq made their first contribution in #725
- @HashCookie made their first contribution in #712
Full Changelog: v0.1.10...v0.1.11
Great work everyone!