You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Confused about mul_mat_q and multiple backends. #626
I am compiling as per the readme for cuBlas but would like to try mul_mat_q kernels to compare speeds. From what I gather these kernels are implemented using openblas?
Does this mean I have to separately compile a llama-cpp-python for each backend and uninstall them in between? Or can I compile one backend with both cuBlas and openblas?
Will mul_mat_q flag also work with cublas compiled only?
Reactions are currently unavailable
Activity
Repository owner locked and limited conversation to collaborators on Aug 23, 2023
Activity