92f7da00b4
* fix(docs): correct typos found during code review Non-functional changes only: - Fixed minor spelling mistakes in comments - Corrected typos in user-facing strings - No variables, logic, or functional code was modified. Signed-off-by: Marcel Petrick <mail@marcelpetrick.it> * Update docs/backend/CANN.md Co-authored-by: Aaron Teo <taronaeo@gmail.com> * Revert "Auxiliary commit to revert individual files from 846d1c301281178efbc6ce6060ad34c1ebe45af8" This reverts commit 02fcf0c7db661d5ff3eff96b2b2db9fdb7213256. * Update tests/test-backend-ops.cpp Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com> * Update tests/test-backend-ops.cpp Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com> --------- Signed-off-by: Marcel Petrick <mail@marcelpetrick.it> Co-authored-by: Aaron Teo <taronaeo@gmail.com> Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
41 lines
1.4 KiB
Markdown
41 lines
1.4 KiB
Markdown
# llama.cpp/example/sycl
|
|
|
|
This example program provides the tools for llama.cpp for SYCL on Intel GPU.
|
|
|
|
## Tool
|
|
|
|
|Tool Name| Function|Status|
|
|
|-|-|-|
|
|
|llama-ls-sycl-device| List all SYCL devices with ID, compute capability, max work group size, etc.|Support|
|
|
|
|
### llama-ls-sycl-device
|
|
|
|
List all SYCL devices with ID, compute capability, max work group size, etc.
|
|
|
|
1. Build the llama.cpp for SYCL for the specified target *(using GGML_SYCL_TARGET)*.
|
|
|
|
2. Enable oneAPI running environment *(if GGML_SYCL_TARGET is set to INTEL -default-)*
|
|
|
|
```
|
|
source /opt/intel/oneapi/setvars.sh
|
|
```
|
|
|
|
3. Execute
|
|
|
|
```
|
|
./build/bin/llama-ls-sycl-device
|
|
```
|
|
|
|
Check the ID in startup log, like:
|
|
|
|
```
|
|
found 2 SYCL devices:
|
|
| | | | |Max | |Max |Global | |
|
|
| | | | |compute|Max work|sub |mem | |
|
|
|ID| Device Type| Name|Version|units |group |group|size | Driver version|
|
|
|--|-------------------|---------------------------------------|-------|-------|--------|-----|-------|---------------------|
|
|
| 0| [level_zero:gpu:0]| Intel Arc A770 Graphics| 1.3| 512| 1024| 32| 16225M| 1.3.29138|
|
|
| 1| [level_zero:gpu:1]| Intel UHD Graphics 750| 1.3| 32| 512| 32| 62631M| 1.3.29138|
|
|
|
|
```
|
|
|