github serge-chat/serge 0.1.0
0.1.0 - Moar Models

latest releases: 0.8.2, 0.8.1, 0.8.0...
18 months ago

Changelog

Quite a few things, but in no particular order:

  • We got rid of the custom wrapper around llama.cpp and we now use the awesome python bindings provided by llama-cpp-python.
  • We also got rid of MongoDB, now Redis is used to handle the chat history using a wrapper provided by langchain. Getting rid of MongoDB means Serge should now be fully compatible with older CPUs that don't support AVX instructions 🎉 Please file a bug report if you still have compatibility issues with your specific hardware.
  • We cleaned up the UI a bit and made the colors more uniform all around.
  • We added the ability to delete an already downloaded model.
  • Speaking of models, we added support for the open assistant models as well as Vicuna. They should be available from the download page in Serge.
  • As a result of those changes, plus some work by @gaby the final image should now be a lot lighter.
  • We fixed a bug related to passing the temperature parameter in the UI. Thanks @agronholm and welcome!

And we're finally bumping the version to 0.1, since we got rid of MongoDB it seemed like the right time.

What's Changed

New Contributors

Full Changelog: 0.0.5...0.1.0

Don't miss a new serge release

NewReleases is sending notifications on new releases.