Hacker News new | ask | show | jobs
by brucethemoose2 1043 days ago
If you can run it as a AI Horde worker, and the home usage is sporadic, you could definitely support more than one person.

Otherwise ~1.5 tokens/s is definitely the minimum you'd want streaming tokens to a single person.