thek0tyara/llama-cpp-turboquant
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 4
2754 commits 1 branch 0 tags 294 MiB
Commit graph

1 commit

Author SHA1 Message Date
Johannes Gäßler
28103f4832
Server: fix seed for multiple slots (#6835) 
* Server: add tests for consistent results

* sampling: separate rng per sampling context
 2024-04-24 11:08:36 +02:00