thek0tyara/llama-cpp-turboquant
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 4
llama-cpp-turboquant/ggml/src/ggml-cann
History
hipudding 9961d244f2
CANN: Resolve soft_max precision issue (#15730) 
Previously, the slope tensor was set to fp16 to improve efficiency.
While this worked correctly in FA, it caused precision issues in soft_max.
This change applies different data types for different operators
to balance both accuracy and performance.
2025-09-02 17:12:37 +08:00
..
acl_tensor.cpp CANN: Implement GLU ops (#14884) 2025-07-26 17:56:18 +08:00
acl_tensor.h CANN: Add the basic supports of Flash Attention kernel (#13627) 2025-05-26 10:20:18 +08:00
aclnn_ops.cpp CANN: Resolve soft_max precision issue (#15730) 2025-09-02 17:12:37 +08:00
aclnn_ops.h CANN: Add ggml_set_rows (#14943) 2025-07-29 22:36:43 +08:00
CMakeLists.txt CANN: add support for ACL Graph (#15065) 2025-08-06 14:12:42 +08:00
common.h CANN: Support eager execution mode under ACL graph compilation (#15712) 2025-09-02 14:07:48 +08:00
Doxyfile CANN: Add the basic supports of Flash Attention kernel (#13627) 2025-05-26 10:20:18 +08:00
ggml-cann.cpp CANN: Support eager execution mode under ACL graph compilation (#15712) 2025-09-02 14:07:48 +08:00