github av/harbor v0.5.13

3 hours ago

Misc

  • harbor models pull no longer prints "Download completed successfully" when the download actually failed. A failed Hugging Face resolve is now reported as an error, and a cache your user cannot write to points you at harbor fixfs.
  • The PrismML backend documents both Bonsai 2 quants with measured numbers: PTQ1_0 (5.95 GB) and PQ2_0 (7.21 GB) answered 19/20 of the same prompts correctly, but PQ2_0 generates about 25% faster.
  • The PrismML docs warn that raising -np above one slot badly degrades answer quality on ROCm; Harbor's default of a single slot is unaffected.

Full Changelog: v0.5.12...v0.5.13

Don't miss a new harbor release

NewReleases is sending notifications on new releases.