Hacker News new | ask | show | jobs
by tokenmaxxinej 59 days ago
input tokens are processed at 10-50 times the speed of output tokens since you can process then in batches and not one at a time like output tokens