server: prevent data race from HTTP threads (#18263)

Browse source

* server: prevent data race from HTTP threads

* fix params

* fix default_generation_settings

* nits: make handle_completions_impl looks less strange

* stricter const

* fix GGML_ASSERT(idx < states.size())

* move index to be managed by server_response_reader

* http: make sure req & res lifecycle are tied together

* fix compile

* fix index handling buggy

* fix data race for lora endpoint

* nits: fix shadow variable

* nits: revert redundant changes

* nits: correct naming for json_webui_settings

...

This commit is contained in:

Xuan-Son Nguyen 2025-12-22 14:23:34 +01:00 • committed by GitHub

parent 3997c78e33

commit 6ce863c803

No known key found for this signature in database

GPG key ID: B5690EEEBB952194

11 changed files with 459 additions and 366 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download patch file Download diff file Expand all files Collapse all files

573

tools/server/server-context.cpp

View file

File diff suppressed because it is too large Load diff