ggml-org/llama.cpp b9927

on GitHub

cli : move to HTTP-based implementation (#24948)

• cli: move to HTTP-based implementation

• wip

• working

• remote server ok

• cli support router mode

Co-authored-by: Piotr Wilkin ilintar@gmail.com

• case: router with only one model

• Apply suggestions from code review

Co-authored-by: Piotr Wilkin (ilintar) piotr.wilkin@syndatis.com

• remove outdated comment

• use destructor instead

• add ftype

• cli-view --> cli-ui

• pimpl

• no more json in header

• nits fixes

• also show model aliases

Co-authored-by: Piotr Wilkin ilintar@gmail.com
Co-authored-by: Piotr Wilkin (ilintar) piotr.wilkin@syndatis.com