thek0tyara/llama-cpp-turboquant
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 4

Updated docs to match functions

Browse source
This commit is contained in:
Alejandro Saucedo 2021-02-09 21:29:58 +00:00
parent 4baba33681
commit 3e91a7737e
2 changed files with 6 additions and 6 deletions
Download patch file Download diff file Expand all files Collapse all files

8
docs/overview/advanced-examples.rst
View file

@ -97,7 +97,7 @@ Record commands in a single submit by using a Sequence to send in batch to GPU.
mgr.evalOpDefault<kp::OpCreateTensor>({tensorLHS, tensorRHS, tensorOutput});
// Create a new sequence
std::weak_ptr<kp::Sequence> sqWeakPtr = mgr.getOrCreateManagedSequence();
std::weak_ptr<kp::Sequence> sqWeakPtr = mgr.sequence();
if (std::shared_ptr<kp::Sequence> sq = sqWeakPtr.lock())
{
@ -226,8 +226,8 @@ Back to `examples list <#simple-examples>`_.
// We need to create explicit sequences with their respective queues
// The second parameter is the index in the familyIndex array which is relative
// to the vector we created the manager with.
mgr.createManagedSequence("queueOne", 0);
mgr.createManagedSequence("queueTwo", 1);
mgr.sequence("queueOne", 0);
mgr.sequence("queueTwo", 1);
// Creates tensor an initializes GPU memory (below we show more granularity)
auto tensorA = std::make_shared<kp::Tensor>(kp::Tensor(std::vector<float>(10, 0.0)));
@ -422,7 +422,7 @@ Now that we have the inputs and outputs we will be able to use them in the proce
kp::Manager mgr;
if (std::shared_ptr<kp::Sequence> sq =
mgr.getOrCreateManagedSequence("createTensors").lock())
mgr.sequence("createTensors").lock())
{
// ...

4
docs/overview/async-parallel.rst
View file

@ -208,8 +208,8 @@ It's worth mentioning you can have multiple sequences referencing the same queue
// We need to create explicit sequences with their respective queues
// The second parameter is the index in the familyIndex array which is relative
// to the vector we created the manager with.
mgr.createManagedSequence("queueOne", 0);
mgr.createManagedSequence("queueTwo", 1);
mgr.sequence("queueOne", 0);
mgr.sequence("queueTwo", 1);
We create the tensors without modifications.