ggml-cuda: add dequant-float matvec (mmvdq) for Q4_K/Q5_K/Q6_K on RDN…#61
Open
Annieren wants to merge 3 commits into
Open
ggml-cuda: add dequant-float matvec (mmvdq) for Q4_K/Q5_K/Q6_K on RDN…#61Annieren wants to merge 3 commits into
Annieren wants to merge 3 commits into