Quite a few changes and features have been added over the past few days, and it's now stable enough that I can call it a full release.
Changelog
Token caching
The server smartly creates IDs to be used for caching tokens now, and sends it to OpenAI, which should increase usage significantly.
Docker:
There's now an official docker container which can be used to allow this project to run across your network, and on multiple machines.
Homebrew
Can now install the CLI python flask server as a package through homebrew, which should make it easier to use.
Token counting
Support for token counting has been added, which should fix the fact that the amount of tokens wasn't showing up in applications like RooCode, and the other issue where the api request never seemed to stop.
Other smaller functionally (but important) fixes include:
- added the "minimal" reasoning option (might be better for code, and would get you more usage)
- refactor of the entire project to hopefully make it more maintainable onwards
Next release will focus mainly on a proper CI/CD pipeline to build and ensure the ChatMock GUI applications are always available and built, for all platforms
Also will work on the rest of the GitHub issues.
upd: cool people at codex also up'd the plus plan's usage limits, should help too
Pull requests from some lovely people
- Update requirements.txt by @ishanray in #9
- fix: stream(legacy): include delta.reasoning alongside reasoning_summary by @FammasMaz in #16
Full Changelog: 1.15...v1.2