github ggml-org/llama.cpp b11624

pre-release3 hours ago
Details

ggml : improve RPC tensor transfer logs (#30481)

  • add rpc_log_format_size() and print byte counts in KiB/MiB/GiB across the
    RPC client, server and transport traces
  • add rpc_log_format_tensor() and include tensor name, op, type and shape in
    the set/get/memset/copy/init tensor logs
  • fix rpc_cmd_name() returning UNKNOWN for SET_TENSOR_2D, GET_TENSOR_2D,
    COMM_INIT, COMM_ALLREDUCE and COMM_FREE
  • move the log helpers to ggml-rpc/log.{h,cpp} under a common rpc_log_ prefix

Assisted-by: pi:llama.cpp/Qwen3.8-Flash-Next

Website:

Attestations:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.