Hacker News new | ask | show | jobs
by nullc 1 hour ago
Just running cpu only w/ Q6 on 9684X I get about 1tok/s ... also still get about 1tok/s/stream when running 16 in parallel.