Hacker News new | ask | show | jobs
by kilnr 1009 days ago
I get about the same speed (35 tok/s) out of 13B Llama2 on a 4070 Ti, FWIW.