github ggml-org/llama.cpp b8970

2 hours ago
Details

common: Intentionally leak logger instance to fix hanging on Windows (#22273)

  • Changed to leak logger singleton to prevent hanging on Windows

  • Fix comment

  • Stopped using static vector

Using std::vector will cause g_col to be released before the logger thread exits, causing the logger thread to touch freed memory causing a crash

  • Change so all logs are output before exit

  • Added debug logging

  • added more logging

  • Added logging

  • Explicitly free logger to avoid hanging on Win

  • Reverted to leak logger instance again

  • Removed debug log and fixed comment

  • Fixed comment


Co-authored-by: Georgi Gerganov ggerganov@gmail.com

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.