Y
Hacker News
new
|
ask
|
show
|
jobs
by
adrian_b
15 days ago
You can, but the reported speeds for such big models were in the range from a token per a dozen seconds to slightly better than 1 or 2 tokens per second.