github ggml-org/llama.cpp b7348

latest releases: b7360, b7358, b7356...
one day ago

Warning

Release Format Update: Linux releases will soon use .tar.gz archives instead of .zip. Please make the necessary changes to your deployment scripts.

cli: new CLI experience (#17824)

  • wip

  • wip

  • fix logging, add display info

  • handle commands

  • add args

  • wip

  • move old cli to llama-completion

  • rm deprecation notice

  • move server to a shared library

  • move ci to llama-completion

  • add loading animation

  • add --show-timings arg

  • add /read command, improve LOG_ERR

  • add args for speculative decoding, enable show timings by default

  • add arg --image and --audio

  • fix windows build

  • support reasoning_content

  • fix llama2c workflow

  • color default is auto

  • fix merge conflicts

  • properly fix color problem

Co-authored-by: bandoti bandoti@users.noreply.github.com

  • better loading spinner

  • make sure to clean color on force-exit

  • also clear input files on "/clear"

  • simplify common_log_flush

  • add warning in mtmd-cli

  • implement console writter

  • fix data race

  • add attribute

  • fix llama-completion and mtmd-cli

  • add some notes about console::log

  • fix compilation


Co-authored-by: bandoti bandoti@users.noreply.github.com

macOS/iOS:

Linux:

Windows:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.