Hacker News new | ask | show | jobs
Show HN: 60% higher tokens per second for 70B custom LLMs (baseten.co)
1 points by mikejulietbravo 694 days ago
We optimized Writer's Palmyra Fin and Palmyra Med for 60% higher TPS at 35% reduced cost