thek0tyara/llama-cpp-turboquant
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 6

server : add documentation for parallel_tool_calls param (#15647)

Browse source 
Co-authored-by: Pierre F <no@p.e>
This commit is contained in:
ExtReMLapin 2025-08-29 19:25:40 +02:00 • committed by GitHub
parent 81017865ee
commit 792b44f2ed
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 4 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

2
tools/server/README.md
View file

@ -1143,6 +1143,8 @@ The `response_format` parameter supports both plain JSON output (e.g. `{"type":
`parse_tool_calls`: Whether to parse the generated tool call.
`parallel_tool_calls` : Whether to enable parallel/multiple tool calls (only supported on some models, verification is based on jinja template).
*Examples:*
You can use either Python `openai` library with appropriate checkpoints: