github bricks-cloud/BricksLLM v1.0.4

latest releases: v1.9.3, v1.9.2, v1.9.1...
10 months ago

Fixed

  • Fixed configuration not found inconsistency with key and provider settings

  • Changed

  • Updated admin server to pull configurations every 5 sec by default

  • Updated prod Dockerfile to have privacy mode turned on

  • Added

  • Added a default OpenAI proxy timeout of 180s

  • Added model and keyId filters to the metrics API

  • Added health check endpoints for both admin and proxy servers

  • Started recording path and method for each proxy request

The full change log can be found here.

Don't miss a new BricksLLM release

NewReleases is sending notifications on new releases.