Hacker News new | ask | show | jobs
by bbatha 19 days ago
What's time to first token? Raw throughput is usually not the problem in local setups in my experience.