thek0tyara/llama-cpp-turboquant
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 4

server: add built-in tools backend support (#20898)

Browse source 
* wip: server_tools

* refactor

* displayName -> display_name

* snake_case everywhere

* rm redundant field

* change arg to --tools all

* add readme mention

* llama-gen-docs
This commit is contained in:
Xuan-Son Nguyen 2026-03-27 10:07:11 +01:00 • committed by GitHub
parent ba38f3becc
commit 20197b6fe3
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
8 changed files with 922 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

3
common/common.h
View file

@ -613,6 +613,9 @@ struct common_params {
bool endpoint_props = false; // only control POST requests, not GET
bool endpoint_metrics = false;
// enable built-in tools
std::vector<std::string> server_tools;
// router server configs
std::string models_dir = ""; // directory containing models for the router server
std::string models_preset = ""; // directory containing model presets for the router server