llama-cpp-turboquant/seldon/Model.py
Alejandro Saucedo 4a54a37590 Added seldon
2020-08-05 08:12:51 +01:00

8 lines
168 B
Python

import subprocess
class Model:
def __init__(self):
pass
def predict(self, X, names=[], meta=[]):
return subprocess.check_output(["bin/main"])