|
|
|
|
|
|
by TheMatten
918 days ago
|
|
|
Seems to be around 3 tokens/s on my laptop, which is faster than average human, but not too fast of course.
On a desktop with mid-range GPU used for offloading, I can get around 12 tokens/s, which is plenty fast for chatting. |
|
|