thek0tyara/llama-cpp-turboquant
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 6

server: split HTTP into its own interface (#17216)

Browse source 
* server: split HTTP into its own interface

* move server-http and httplib to its own file

* add the remaining endpoints

* fix exception/error handling

* renaming

* missing header

* fix missing windows header

* fix error responses from http layer

* fix slot save/restore handler

* fix case where only one stream chunk is returned

* add NOMINMAX

* do not call sink.write on empty data

* use safe_json_to_str for SSE

* clean up

* add some comments

* improve usage of next()

* bring back the "server is listening on" message

* more generic handler

* add req.headers

* move the chat template print to init()

* add req.path

* cont : minor

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
This commit is contained in:
Xuan-Son Nguyen 2025-11-17 22:05:44 +01:00 • committed by GitHub
parent 38e2c1b412
commit 0de8878c96
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
5 changed files with 1245 additions and 930 deletions
Download patch file Download diff file Expand all files Collapse all files

1677
tools/server/server.cpp
View file

File diff suppressed because it is too large Load diff