thek0tyara/llama-cpp-turboquant
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 4

scripts: benchmark for HTTP server throughput (#14668)

Browse source 
* scripts: benchmark for HTTP server throughput

* fix server connection reset
This commit is contained in:
Johannes Gäßler 2025-07-14 13:14:30 +02:00 • committed by GitHub
parent 0f4c6ec0f1
commit 494c5899cb
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
4 changed files with 218 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
requirements/requirements-all.txt
View file

@ -3,6 +3,7 @@
-r ../tools/server/tests/requirements.txt
-r ./requirements-compare-llama-bench.txt
-r ./requirements-server-bench.txt
-r ./requirements-pydantic.txt
-r ./requirements-test-tokenizer-random.txt

5
requirements/requirements-server-bench.txt Normal file
View file

@ -0,0 +1,5 @@
datasets~=3.2.0
matplotlib~=3.10.0
numpy~=1.26.4
requests~=2.32.3
tqdm~=4.67.1