github mw00/project-maya v1.1.57

51 minutes ago

GLM-5.3 (744B) joins Maya: Z.ai's full GLM-5.3 on Maya's GLM engine, with a new look for the project and fixes.

  • GLM-5.3 (744B): Z.ai's GLM-5.3 (744 B parameters, about 40 B active per token) runs on the same engine, server and dashboard as GLM-5.3-Flash, shown as "GLM-5.3 (744B) · UD-IQ2_M".
    • The files: unsloth's UD-IQ2_M GGUF (238.6 GB), pinned and checked shard by shard. Set it up with ./maya.sh --setup --model GLM-5.3-UD-IQ2_M (Windows: START-MAYA.bat --setup --model GLM-5.3-UD-IQ2_M), or with --gguf-dir <folder> for GGUF files you already have. The dashboard's model list offers it too.
    • Where it runs: NVIDIA from the Tesla V100 on (CUDA, Linux and Windows) and AMD (HIP, the Strix and Gorgon Halo included). Not on Mac or Pascal cards. About 256 GB of VRAM and RAM together keeps every expert in memory; with less, Maya reads the rest from the SSD while it answers, so keep the model on an NVMe SSD.
    • Text only (the model has no vision tower; a picture gets a clear message), up to 1M context: the setup offers the contexts that fit your GPUs.
    • Its own defaults from the model card: temperature 1.0, top-p 0.95, thinking at Max with a 32K-token thinking budget, plus Low, High and thinking off. Z.ai's own chat template.
    • Everything GLM-5.3-Flash has: drafting with the model's own MTP block, the memory tiers and the CPU lane, speed calibration, tool calls, reasoning in every API (OpenAI, Responses, Anthropic and Maya's model API) and the loop guard. Details: docs/GLM53.md.
  • A new look (#881): the new Maya logo in the README, the browser tab, the home-screen icon and the sidebar; issue forms, a docs index and SECURITY.md.
  • Which model fits your PC: docs/MEMORY.md lists each model's recommended memory (VRAM and RAM together), with examples.
  • Fixes:
    • Server: a SIGTERM or Ctrl+C right as the server was waiting could hang it for good. It now stops.
    • Maya's model API (/api/chat, /api/generate): "think": false now turns thinking off. Before, thinking stayed on for every model.
    • DeepSeek: a video in a request now gets a clear error ("reads pictures, not videos") instead of an encoder error, or being dropped next to a picture.
    • Setup: the line under the logo now names the model being set up. It said GLM-5.3-Flash whichever model was picked.

Thanks to unsloth for the GLM-5.3 GGUF.

Maya is free; if it helps you, you can sponsor it: https://github.com/sponsors/mw00

Don't miss a new project-maya release

NewReleases is sending notifications on new releases.