thek0tyara/llama-cpp-turboquant
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 4
1089 commits 1 branch 0 tags 294 MiB
Commit graph

87 commits

Author SHA1 Message Date
Fabian Sauter
cf721cc21a Option to disable logging completely. 
Signed-off-by: Fabian Sauter <sauter.fabian@mailbox.org>
 2022-07-27 12:48:46 +02:00
Fabian Sauter
726fae58f1 Added an option to get the current vk instance 
Signed-off-by: Fabian Sauter <sauter.fabian@mailbox.org>
 2022-07-27 12:48:46 +02:00
Fabian Sauter
917b6f6872 Added an option to get the current vk instance 
Signed-off-by: Fabian Sauter <sauter.fabian@mailbox.org>
 2022-07-27 12:48:04 +02:00
Fabian Sauter
f01bcb68a5 New logging framework 
Signed-off-by: Fabian Sauter <sauter.fabian@mailbox.org>
 2022-07-27 12:48:04 +02:00
Fabian Sauter
88b06ad521 Fixed compiler warnings 
Signed-off-by: Fabian Sauter <sauter.fabian@mailbox.org>
 2022-05-20 09:43:35 +02:00
Fabian Sauter
24cd307042 Added .clang-format file and formatted everything 
Signed-off-by: Fabian Sauter <sauter.fabian@mailbox.org>
 2022-05-02 15:11:40 +02:00
Alejandro Saucedo
d2d9ae6873 Android fixed example 
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
 2022-01-30 13:30:41 +00:00
Alejandro Saucedo
797ba87c2a Updated formatting 
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
 2021-11-16 23:03:43 +00:00
ItsBasi
c181654f09 Avoid using pointers to temporary copies of desired extensions. 
validExtensions now references data that remains constant for its entire life-time.

Signed-off-by: ItsBasi <5033630+ItsBasi@users.noreply.github.com>
 2021-09-16 14:06:32 +02:00
Alejandro Saucedo
3eb97dbd05 Fix for null debug 
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
 2021-09-15 14:17:47 +01:00
Alejandro Saucedo
c23573eb47 Added template function for algorithm on manager 
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
 2021-09-12 16:52:15 +01:00
Alejandro Saucedo
860fda9fb5 Initil implementation 
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
 2021-09-12 15:19:11 +01:00
Alejandro Saucedo
e4d85057d9 updated license and files 2021-07-21 21:12:26 +01:00
Alejandro Saucedo
53039040ba Updated naming on code files 2021-05-11 09:56:44 +01:00
unexploredtest
1a39f87dd3 omitted .data() because it is incompatible with vulkan 1.1.x 2021-04-19 14:38:16 +04:30
unexploredtest
629c6e38ce changing the way deviceCount is obtained for compatibality 2021-04-16 17:22:17 +04:30
unexploredtest
71498b2030 Added identation 2021-04-12 12:34:55 +04:30
unexploredtest
429f3aaacf Raises an error if 1: There is no Vulkan device 2: physicalDeviceIndex exceeds the device limit 2021-04-12 10:25:48 +04:30
Alejandro Saucedo
a8e5ce7903 Added functionality to get list of devices 2021-03-20 08:49:27 +00:00
alexander-g
d71d169886 raw vk::deviceproperties and python dict 2021-03-12 09:51:31 +01:00
alexander-g
f52efcef0f Device Properties 2021-03-12 08:32:51 +01:00
Alejandro Saucedo
1d1018fa0c Reformat 2021-03-07 14:45:31 +00:00
Alejandro Saucedo
ad18c2e546 Initial implementation of tensor working compiling 2021-03-07 14:08:56 +00:00
alexander-g
259d3f1d13 test case 2021-03-07 14:16:50 +01:00
alexander-g
6da6bca339 requested changes 2021-03-07 12:25:41 +01:00
alexander-g
eb47d52047 Merge branch 'master' into timestamps 2021-03-06 13:18:21 +01:00
alexander-g
6f5a8f8968 support for timestamps 2021-03-06 11:45:29 +01:00
Alejandro Saucedo
71129392c2 Added functionality with atomicadd 2021-03-05 08:19:56 +00:00
Alejandro Saucedo
9a40465d69 Added kompute env debug layer param 2021-03-04 22:20:30 +00:00
Alejandro Saucedo
ffdb41772d Added kompute env debug layer param 2021-03-04 21:47:58 +00:00
Alejandro Saucedo
91872048d4 Added kompute env layers 2021-03-04 21:42:06 +00:00
Alejandro Saucedo
c211c22a78 Updated constants to be set as part of descriptor layout 2021-03-04 08:10:28 +00:00
Alejandro Saucedo
63e220a8a4 Reformat 2021-02-28 16:02:37 +00:00
Alejandro Saucedo
7dc1f35206 Added support for push constants 2021-02-28 13:59:01 +00:00
Alejandro Saucedo
91d3b9a223 All python tests pass 2021-02-28 07:57:36 +00:00
Alejandro Saucedo
4c4d073b90 Python implementation 2021-02-27 19:37:31 +00:00
Alejandro Saucedo
198fb46eb6 Fixed integration tests fails due to pipeline not freed 2021-02-27 15:28:24 +00:00
Alejandro Saucedo
3304767f2c Updated to enable for opmult to work 2021-02-27 14:49:13 +00:00
Alejandro Saucedo
6378583a23 Further tests added to new structure 2021-02-27 14:49:13 +00:00
Alejandro Saucedo
3f1288271d Working initial base 2021-02-27 14:49:12 +00:00
Alejandro Saucedo
f35a62ee9d Updated core initial running test 2021-02-27 14:49:12 +00:00
Alejandro Saucedo
635fdb02be Added baseline functionality including new memory models 2021-02-27 14:49:12 +00:00
Alejandro Saucedo
9aae5d69db Initial checkpoint with reasonable workflow 2021-02-27 14:49:12 +00:00
Alejandro Saucedo
29c50e5728 Amended SPDLOG_X log functions to be KP_LOG_X 2021-02-21 11:51:34 +00:00
Alejandro Saucedo
c83ba44549 Moved destroy and rebuild functions to cpp 2021-02-10 08:44:25 +00:00
Alejandro Saucedo
d9789b63d2 Added initial destroy and updated rebuild functions 2021-02-10 08:41:31 +00:00
Alejandro Saucedo
0d9a9758da Renamed tensor and rebuild functions 2021-02-09 21:29:24 +00:00
Alejandro Saucedo
b34984b713 Updating sequence to have isInit until init run 2021-02-09 19:19:39 +00:00
Alejandro Saucedo
aa75fdae47 format 2021-02-08 19:43:50 +00:00
Alejandro Saucedo
f62e353f4a Removed persistent anonymous sequences 2021-02-08 19:39:58 +00:00