github mw00/project-maya v1.1.65

40 minutes ago

A stability release: fixes for start-up and loading failures on AMD and Windows, a steadier AMD + NVIDIA pairing, clearer errors when the engine fails, and a test suite where a red test always means something.

  • Fix: GLM on two 16 GB AMD cards found no room for the experts (#899, @bob-u): on Linux with AMD GPUs, the free VRAM read right after Maya's budget check could still count the checked memory as used, so the expert pool got 0 slots and the engine stopped at start. Maya now waits until the freed memory reads as free again (MAYA_GLM_POOL_CHECK_WAIT_MS, Linux HIP only). The automatic layer split works again; the manual split is no longer needed.
  • Fix: DeepSeek on Windows with several NVIDIA GPUs failed with "0 MiB free" (#794, @wolfwoof88, @benjaminfphillips and @KuroNekoMaid): pinning the RAM copy of the experts could leave every GPU without usable VRAM on Windows. Maya now reads each GPU's free VRAM before and after the pin, and undoes the pin by itself when it leaves a GPU nearly empty, so DS4_COPY_PIN=0 is no longer needed. When the free VRAM cannot be read, the load line now says why instead of "0 MiB free".
  • Steadier AMD + NVIDIA pairing: the APU side now imports the shared expert memory in a way the AMD driver does not track, so Linux moving memory around no longer pauses it for seconds at a time. GLM-5.3 (744B) still starts on the APU alone unless you use --mixed-gpus on.
  • The same answers on every install of the AMD + NVIDIA pairing: how the pair splits prompt work between the CPU and the GPUs no longer depends on a few percent of difference in each build's measured CPU timing, so two installs of the same model on the same GPUs give the same answers (MAYA_GLM_LANE_STEPS=0 restores the old behaviour). EXL3 answers on the pair can differ slightly from v1.1.64.
  • Clearer errors when the engine fails (#827, @anbow1): an answer the engine stops because of a GPU fault is now reported as an error, not as "length". Streamed answers keep the text already sent and end with the API's own error event; other requests get HTTP 422 with type engine_error (not retried automatically by the OpenAI and Anthropic SDKs), the reason, the position and the partial text. The console line now names the failed step, the position and the context size.
  • Finding a GLM drafting stall (#860, @githug2024): if one drafting step takes longer than 20 s, the log now prints a glm stall: line saying where each GPU is stuck (MAYA_GLM_STALL_S). It only reports.
  • Smaller fixes:
    • The "use a smaller --vram-reserve-mib" hint now only appears when it can help, and says that setting the reserve by hand turns off its automatic shrinking.
    • The help says which flags a start of an existing config ignores.
    • A speed calibration you ask for by name now runs when a GPU only holds a display's memory, with a warning; it still refuses while another Maya model is loaded.
    • AMD install docs: what to do when Ubuntu's rocWMMA package lacks headers.
    • strata-device accepts GPUs from compute capability 6.0, like the rest of Maya.
  • Tests: every known failing or flaky test now has its cause fixed: tests that need model files skip with the reason instead of failing, slow GPU tests are 5-8 times faster, tests that clashed in parallel runs no longer do, and the Windows and nohup runs pass.

Full list: CHANGELOG.md.

Supported by @wjHunter, @os-groot, @davedgd, @jeanluchayes, @sugattor, @vikcious, @ThatSimpleTech, @router0mail and @davidfernengel.

Maya is free; if it helps you, you can sponsor it: https://github.com/sponsors/mw00

Don't miss a new project-maya release

NewReleases is sending notifications on new releases.