thek0tyara/llama-cpp-turboquant
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 4

Added function in sequence freeMemoryDestroyGPUResources to de-init

Browse source
This commit is contained in:
Alejandro Saucedo 2020-11-03 08:59:32 +00:00
parent b636a80d06
commit 5fbb4ce6f6
4 changed files with 62 additions and 38 deletions
Download patch file Download diff file Expand all files Collapse all files

2
src/Manager.cpp
View file

@ -63,7 +63,7 @@ Manager::~Manager()
"managed sequences");
for (const std::pair<std::string, std::shared_ptr<Sequence>>& sqPair :
this->mManagedSequences) {
sqPair.second->~Sequence();
sqPair.second->freeMemoryDestroyGPUResources();
}
this->mManagedSequences.clear();
}