v0.7.8
Features:
- Added a 'submit on enter' settings option for text input.
- Added option to save KV cache with the Local API. This will save the current local context to storage after every generation, allowing you to pick up where you last left off and negate reprocessing context. The cache will reset on new chats or swapping models.
- WARNING: This feature uses a LOT of memory and will write several MB/GB every message based on model size. This may incur high battery drain and performance degredation on older devices. Because of this, the option is hidden away in the settings menu rather than being placed in the Local API tab.
- Added Sonnet 3.5 to Claude models.
- Added Autoformat New Chats feature to format inputs to preferred format, useful for formatting cards obtained from third parties.
- This option will automatically detect the existing format for new chat greetings, then will convert to the selected format:
- Mode 0 - None
- Mode 1 -
PlainActionQuoteSpeech-This is an action. "This is some speech." - Mode 2 -
AsteriskActionPlainSpeech-*This is an action.* This is some speech. - Mode 3 -
AsteriskActionQuoteSpeech-*This is an action.* "This is some speech." - DISCLAIMER: This feature uses some pretty wacky regex to work, so kindly report bad conversions alongside the problematic text.
- Added option to toggle usage of Example Messages.
- Added option to add a timestamp to messages.
Changes:
- Improved the UX of numerous long buttons with side buttons to be less prone to accidental clicks. These buttons are now properly segmented instead of being nested.
- Removed animation from editor due to buggy behavior with several keyboards. As such, the relevant option in Settings has also been hidden.
- UX improvements in the Local API menu - buttons now disable based on app/model state.
- Changed base-64 library used to a faster alternative.
Fixes:
- Fixed Claude compatiblity.
- Fixed Claude API not taking custom first message.
- Fixed issues with local auto-loading not respecting params such as context size and thread count.
- Fixed Local generations not printing last token.
- Fixed Horde API calls missing headers.
- Merged fixes by @Henri-J-Norden for the OpenAI API. (Thanks!)
Dev stuff:
- [Dev] Refactored naming schema for functions which operate on the database
- [Dev] Added automatic workflow to trigger builds upon push