Hacker News new | ask | show | jobs
by JPLeRouzic 84 days ago
Has anyone started to implement this technique in Llama.cpp or similar inference tool?
1 comments
dnhkng 84 days ago
There was some work done on this a while back, during the FrankenMerge craze of 23'

I am working with TurboDerp to integrate this into the Exllama v3 format.

link
sigbottle 84 days ago
Wow, super interesting keywords. Are you a ML researcher? What kind of experiments do you do?
link