thek0tyara/llama-cpp-turboquant
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 4

Added function in sequence freeMemoryDestroyGPUResources to de-init

Browse source
This commit is contained in:
Alejandro Saucedo 2020-11-03 08:59:32 +00:00
parent b636a80d06
commit 5fbb4ce6f6
4 changed files with 62 additions and 38 deletions
Download patch file Download diff file Expand all files Collapse all files

5
single_include/kompute/Kompute.hpp
View file

@ -1100,6 +1100,11 @@ class Sequence
*/
bool isInit();
/**
* Destroys and frees the GPU resources which include the buffer and memory.
*/
void freeMemoryDestroyGPUResources();
/**
* Record function for operation to be added to the GPU queue in batch. This
* template requires classes to be derived from the OpBase class. This