Hacker News new | ask | show | jobs
by 2001zhaozhao 54 days ago
I wonder whether it is much more cost-effective in terms of token throughput / hardware+power cost to get actual GPUs instead, given that the model size is only 27B.