github av/harbor v0.1.18

latest releases: v0.3.41, v0.3.40, v0.3.39...
17 months ago

v0.1.18

This is another maintenance release mainly focused on the bench functionality

  • vllm is bumped to v0.6.0 by default, harbor now also uses a version with bitsandbytes pre-installed (run harbor build vllm to pre-build it)
  • bench - judge prompt, eval log, exp. backoff for the LLM
  • CheeseBench is out, smells good though

Full Changelog: v0.1.17...v0.1.18

Don't miss a new harbor release

NewReleases is sending notifications on new releases.