github magnitudedev/magnitude @magnitudedev/cli@0.2.15

3 hours ago

0.2.15

Patch Changes

  • ae7875a Thanks @thrgreenwald! - The inference engine's Anthropic-compatible messages and token-counting endpoints now accept any anthropic-version header value, or no header, instead of rejecting clients that do not send 2023-06-01.

  • ae7875a Thanks @anerli! - Fix model loading on Metal exceeding its reserved weight-import memory when streaming weight tables (#231). Import batches now share the memory plan used to reserve their budget, accounting for mapped file spans and simultaneous staged uploads.

Don't miss a new magnitude release

NewReleases is sending notifications on new releases.