Refusal ablation for DeepSeek, MiniMax and GLM-5.3-Flash, Turbo for GLM-5.3 (744B), a setup that recommends the quant and context your PC's memory holds, and fixes.
- The setup recommends the quant your PC holds: each model's list (GLM-5.3-Flash, GLM-5.3 (744B), DeepSeek and MiniMax) now recommends the largest quant, up to the model's usual pick, whose files and default cache fit in your VRAM and RAM together, so no expert has to be read from the SSD. AMD Ryzen AI Max APUs and Macs count their shared memory once. Every quant stays in the list. For GLM-5.3 (744B) the recommendation is at most GLM-5.3-Maya-XS.
- GLM-5.3 (744B) on AMD Ryzen AI Max APUs: the setup recommends the largest context that still keeps the whole model in memory. A longer context you choose is kept, with a warning that some experts will then come from the SSD.
- Turbo for GLM-5.3 (744B): the Turbo button now works for GLM-5.3 too, with its own setting: it prefers the experts already in VRAM (
MAYA_GLM_ROUTE_AFFINITY=0.2) and uses a 32K context. With GLM-5.3-Maya-XS, part of it outside VRAM, decoding was about 22-25% faster on our test PC. Like all of Turbo it changes the answers, it is off until you switch it on, and switching it off restores your settings exactly. - Dashboard: Settings > Chat defaults shows a small "Saved" tick after every change.
- Refusal ablation for DeepSeek-V4.1-Flash, MiniMax-M3.1-Flash and GLM-5.3-Flash: Maya's own direction files are now in each model's repo, and the setup downloads them. It is off until you switch it on (the Models page, or a request's
"ablate"); with it off the answers are unchanged. On held-out test prompts, refused requests went from 98% to 1% (DeepSeek), 100% to 7% (MiniMax) and 100% to 4% (GLM-5.3-Flash), with no extra refusals of ordinary requests. Fitting your own withtools/ablate_fit.pynow works on MiniMax and GLM-5.3. - Fixes:
- GLM-5.3 (744B) and GLM-5.3-Flash keep their own chat defaults on the dashboard; changing one no longer changes the other.
--parallelwith fair slices (MAYA_FAIR_SLICE_S): one waiting request pauses one running answer, not all of them (thanks @HTsulfuric for #883).- DeepSeek with
DS4_LENT_RAM_GB: a failed copy no longer makes every request fail with HTTP 400; prompts run as they do without the setting (#884). - DeepSeek on NVIDIA tensor-parallel pairs:
MAYA_DS4_HIP_PEER_AR=auto/1uses the direct GPU-to-GPU prompt all-reduce again, as in v1.1.54; the answers are the same.
Full list: CHANGELOG.md.
Supported by @wjHunter, @os-groot, @davedgd, @jeanluchayes, @sugattor, @vikcious, @ThatSimpleTech, @router0mail and @davidfernengel.
Maya is free; if it helps you, you can sponsor it: https://github.com/sponsors/mw00