thek0tyara/llama-cpp-turboquant
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 4

Python implementation

Browse source
This commit is contained in:
Alejandro Saucedo 2021-02-27 19:37:31 +00:00
parent 198fb46eb6
commit 4c4d073b90
18 changed files with 3172 additions and 3349 deletions
Download patch file Download diff file Expand all files Collapse all files

3
src/Manager.cpp
View file

@ -346,8 +346,7 @@ Manager::createDevice(const std::vector<uint32_t>& familyQueueIndices, uint32_t
std::shared_ptr<Tensor>
Manager::tensor(
const std::vector<float>& data,
Tensor::TensorTypes tensorType,
bool syncDataToGPU)
Tensor::TensorTypes tensorType)
{
KP_LOG_DEBUG("Kompute Manager tensor creation triggered");