What's Changed
-
Fix chat in firefox. submit form is deprecated by @Nikorag in #151
-
Addressed: https://github.com//issues/157#issuecomment-2593746955
-
Addressed: https://github.com//discussions/142
-
Regarding the Ollama Service and Context size, I implemented a dynamic way of using num_ctx parameter. Now there is a "maximum" context size of 100.000 Tokens. Thats huge and most systems won't handle that. The solution comes in handy and checks how much tokens are needed for the prompt (based on Q4_0 Quantization Size), it adds a buffer for the response of 1024 tokens (thats more enough in my eyes for the JSON response) and transfers the new calculated num_ctx to the Ollama API call.
-
You now have the ability to view the full prompt + response log in /app/logs/prompt.txt
New Contributors
Full Changelog: v2.1.9...v2.2.0