|
|
|
|
|
|
by throwdbaaway
27 days ago
|
|
|
And their disk-based caching is amazing. I got a long 700k context session spanning more than a week, with pauses in between that was longer than a day, and some rewinds mixed in as well. Stats from pi: ↑400k ↓438k R432M 71.9%/1.0M Half a billion tokens, $2.12 |
|
|