github ggml-org/llama.cpp b8841

latest releases: b12114, b12111, v0.9.0...
6 months ago
Details

rpc : refactor the RPC transport (#21998)

  • rpc : refactor the RPC transport

Move all transport related code into a separate file and use the
socket_t interface to hide all transport implementation details.

  • fix win32

  • better socket_t construction

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.