Y
Hacker News
new
|
ask
|
show
|
jobs
by
VHRanger
1176 days ago
Not exactly. It's that the model is loading less stuff out of the mmap'ed weights that you would expect.
The author of the mmap patch chimes in here:
https://news.ycombinator.com/item?id=35393615