Commit graph

1197 commits

Author SHA1 Message Date
Jared Van Bortel
2d0a8abc64 sync changes from nomic-ai/llama.cpp 2023-12-13 17:51:59 -05:00
Adam Treat
7ac0862445 Major refactor to kompute allowing controlling buffers outside of the tensor object. 2023-07-24 19:36:42 -04:00
Adam Treat
5db4a58550 Allow to set tensors. 2023-07-21 21:54:15 -04:00
Adam Treat
747aab98fc Use a global cache for the pipeline. 2023-07-21 21:53:47 -04:00
Adam Treat
ae5f122b77 Fix build again. 2023-07-21 12:33:05 -04:00
Adam Treat
746ff8a848 Fix build. 2023-07-21 12:30:25 -04:00
Adam Treat
d3ad3aa657 Allow pre-allocated memory from vulkan for staging host. 2023-07-21 12:18:29 -04:00
Alejandro Saucedo
63567a72be
Merge pull request #325 from Crydsch/fix_check_vulkan_version
Fix vulkan version parsing
2023-05-28 02:34:18 -06:00
crydsch
cd831a76fb Fix vulkan version parsing
Signed-off-by: crydsch <crydsch@lph.zone>
2023-05-02 17:59:43 +02:00
Alejandro Saucedo
e7890bbb4d
Delete blank Kompute.hpp file 2022-12-03 17:48:51 +00:00
Alejandro Saucedo
6cbb0f7062
Merge pull request #316 from KomputeProject/adding_storage_tensor
Adding storage tensor functionality with tests
2022-12-03 17:43:42 +00:00
Alejandro Saucedo
65c52aaf9c
Added documentation for async logging flag
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-12-03 17:25:53 +00:00
Alejandro Saucedo
2f5a88c136
Added tests to validate that storage buffers work correctly
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-12-03 17:24:12 +00:00
Alejandro Saucedo
f7a77ed521
Added functionaliy for eStorage buffers to work correctly
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-12-03 17:24:00 +00:00
Alejandro Saucedo
201e43b25d
Added option for spdlog sync mode to ensure consistent debugging
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-12-03 17:23:37 +00:00
Alejandro Saucedo
f68340e48a
Added option for spdlog sync mode to ensure consistent debugging
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-12-03 17:23:25 +00:00
Alejandro Saucedo
09c1a4afee
Merge pull request #315 from KomputeProject/logging_fixes
Logging fixes for spdlog
2022-11-27 11:52:33 +00:00
Alejandro Saucedo
af821278cf
Added shorter log
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-27 11:49:35 +00:00
Alejandro Saucedo
05237ee3f3
Added shorter log
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-27 11:39:52 +00:00
Alejandro Saucedo
206f330d39
Fixes for spdlog to reflect active level
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-27 11:26:38 +00:00
Alejandro Saucedo
a16100cbf0
Updated makefile to use debug messaging by default
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-27 11:26:22 +00:00
Alejandro Saucedo
4c978d1f2c
Updated ccls to point to build files
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-27 11:25:58 +00:00
Alejandro Saucedo
cbc8d22585
Merge pull request #314 from KomputeProject/update_examples_Tests
Adding CI setup to ensure examples are tested automatically
2022-11-26 17:04:57 +00:00
Alejandro Saucedo
cd4f22524e
Updated android test to work with source branch
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-26 16:58:44 +00:00
Alejandro Saucedo
648ec502b1
Updated example to map results
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-26 16:58:28 +00:00
Alejandro Saucedo
29f6d8c0e9
Added logistic regression check output
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-26 16:38:00 +00:00
Alejandro Saucedo
342afccaf3
Added logistic regression check output
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-26 16:35:06 +00:00
Alejandro Saucedo
cf1dec9132
Added logistic regression test in CI
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-26 16:32:09 +00:00
Alejandro Saucedo
bc1149a421
Added test with assert in test
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-26 16:29:23 +00:00
Alejandro Saucedo
a434e0a791
Added initial example for automated CI
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-26 16:10:45 +00:00
Alejandro Saucedo
243c684ac3
Added initial example for automated CI
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-26 16:07:36 +00:00
Alejandro Saucedo
9d007e5c04
Added initial example for automated CI
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-26 15:57:54 +00:00
Alejandro Saucedo
b02640a026
Added initial example for automated CI
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-26 15:55:19 +00:00
Alejandro Saucedo
c48d2d1539
Added initial example for automated CI
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-26 15:54:10 +00:00
Alejandro Saucedo
54cb362729
Added initial example for automated CI
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-26 15:51:27 +00:00
Alejandro Saucedo
8e3b52cd56
Added initial example for automated CI
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-26 15:46:25 +00:00
Alejandro Saucedo
2e258610aa
Added initial example for automated CI
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-26 15:42:18 +00:00
Alejandro Saucedo
c4a4dc4908
Added initial example for automated CI
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-26 15:41:58 +00:00
Alejandro Saucedo
8a3d2277b7
Added initial example for automated CI
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-26 15:39:23 +00:00
Alejandro Saucedo
637bfb1bc0
Merge pull request #312 from KomputeProject/axsaucedo-patch-5
Updating default headers to Vulkan v1.3.231
2022-11-26 07:48:03 +00:00
Alejandro Saucedo
0cd2d7a52a
Updating default headers to Vulkan v1.3.231
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-26 07:44:30 +00:00
Alejandro Saucedo
a40adf8335
Merge pull request #311 from hungrymonkey/fixbuilderror
Fixed build error on gcc 12
2022-11-26 07:41:45 +00:00
hungrymonkey
9eac80f048 Fixed build error on gcc 12
Steps to reproduce

$git clone https://github.com/KomputeProject/kompute.git
$cmake -Bbuild
$cd build
$make

$gcc (SUSE Linux) 12.2.1 20221020 [revision 0aaef83351473e8f4eb774f8f999bbe87a4866d7]
Copyright (C) 2022 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

 $lsb_release -a
LSB Version:    n/a
Distributor ID: openSUSE
Description:    openSUSE Tumbleweed
Release:        20221124
Codename:       n/a

Error log
In file included from /home/doof/gitrepo/kompute/src/include/kompute/operations/OpTensorCopy.hpp:6,
                 from /home/doof/gitrepo/kompute/src/OpTensorCopy.cpp:3:
/home/doof/gitrepo/kompute/src/include/kompute/Tensor.hpp:55:27: error: expected ‘)’ before ‘<’ token
   55 |     Tensor(std::shared_ptr<vk::PhysicalDevice> physicalDevice,
      |           ~               ^
      |                           )
/home/doof/gitrepo/kompute/src/include/kompute/Tensor.hpp:108:30: error: ‘std::shared_ptr’ has not been declared
  108 |                         std::shared_ptr<Tensor> copyFromTensor);
      |                              ^~~~~~~~~~
/home/doof/gitrepo/kompute/src/include/kompute/Tensor.hpp:108:40: error: expected ‘,’ or ‘...’ before ‘<’ token
  108 |                         std::shared_ptr<Tensor> copyFromTensor);
      |                                        ^
/home/doof/gitrepo/kompute/src/include/kompute/Tensor.hpp:256:10: error: ‘shared_ptr’ in namespace ‘std’ does not name a template type
  256 |     std::shared_ptr<vk::PhysicalDevice> mPhysicalDevice;
      |          ^~~~~~~~~~
/home/doof/gitrepo/kompute/src/include/kompute/Tensor.hpp:6:1: note: ‘std::shared_ptr’ is defined in header ‘<memory>’; did you forget to ‘#include <memory>’?
    5 | #include "logger/Logger.hpp"
  +++ |+#include <memory>
    6 | #include <string>
/home/doof/gitrepo/kompute/src/include/kompute/Tensor.hpp:257:10: error: ‘shared_ptr’ in namespace ‘std’ does not name a template type
  257 |     std::shared_ptr<vk::Device> mDevice;
      |          ^~~~~~~~~~
/home/doof/gitrepo/kompute/src/include/kompute/Tensor.hpp:257:5: note: ‘std::shared_ptr’ is defined in header ‘<memory>’; did you forget to ‘#include <memory>’?
  257 |     std::shared_ptr<vk::Device> mDevice;
      |     ^~~
/home/doof/gitrepo/kompute/src/include/kompute/Tensor.hpp:260:10: error: ‘shared_ptr’ in namespace ‘std’ does not name a template type
  260 |     std::shared_ptr<vk::Buffer> mPrimaryBuffer;
      |          ^~~~~~~~~~
/home/doof/gitrepo/kompute/src/include/kompute/Tensor.hpp:260:5: note: ‘std::shared_ptr’ is defined in header ‘<memory>’; did you forget to ‘#include <memory>’?
  260 |     std::shared_ptr<vk::Buffer> mPrimaryBuffer;
      |     ^~~
/home/doof/gitrepo/kompute/src/include/kompute/Tensor.hpp:262:10: error: ‘shared_ptr’ in namespace ‘std’ does not name a template type
  262 |     std::shared_ptr<vk::Buffer> mStagingBuffer;

Final result

$make
[ 16%] Built target fmt
[ 27%] Built target kp_shader
[ 38%] Built target kp_logger
[ 44%] Building CXX object src/CMakeFiles/kompute.dir/Algorithm.cpp.o
[ 50%] Building CXX object src/CMakeFiles/kompute.dir/Manager.cpp.o
[ 55%] Building CXX object src/CMakeFiles/kompute.dir/OpAlgoDispatch.cpp.o
[ 61%] Building CXX object src/CMakeFiles/kompute.dir/OpMemoryBarrier.cpp.o
[ 66%] Building CXX object src/CMakeFiles/kompute.dir/OpTensorCopy.cpp.o
[ 72%] Building CXX object src/CMakeFiles/kompute.dir/OpTensorSyncDevice.cpp.o
[ 77%] Building CXX object src/CMakeFiles/kompute.dir/OpTensorSyncLocal.cpp.o
[ 83%] Building CXX object src/CMakeFiles/kompute.dir/Sequence.cpp.o
[ 88%] Building CXX object src/CMakeFiles/kompute.dir/Tensor.cpp.o
[ 94%] Building CXX object src/CMakeFiles/kompute.dir/Core.cpp.o
[100%] Linking CXX static library ../lib/libkompute.a
[100%] Built target kompute

Fixes Issue #310

Signed-off-by: hungrymonkey <tedchang2010@gmail.com>
2022-11-25 19:35:50 -08:00
Alejandro Saucedo
6b8b6e864a
Merge pull request #309 from KomputeProject/1_3_vulkan_upgrade
Upgrading to Vulkan 1.3
2022-11-20 13:52:43 +00:00
Alejandro Saucedo
b23e925636
Removed parallel as caused issues in build
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-20 13:47:15 +00:00
Alejandro Saucedo
06e5c159f5
Updating cmake build from fork
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-20 12:45:57 +00:00
Alejandro Saucedo
a48003afef
Reduced size of swiftshader 2gb->150mb
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-20 12:45:56 +00:00
Alejandro Saucedo
c501ff6dca
Updated cpp tests to use latest images
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-20 12:45:56 +00:00
Alejandro Saucedo
d9075cdbec
Updated python tests to use new images
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-20 12:45:56 +00:00
Alejandro Saucedo
227a6cf998
Updated kompute to use latest vulkan version based on sdk image
Signed-off-by: Alejandro Saucedo <axsauze@gmail.com>
2022-11-20 12:45:55 +00:00