Y
Hacker News
new
|
ask
|
show
|
jobs
by
bearjaws
46 days ago
I am curious if it reuses the LLM across all tabs, hard to imagine most machines can boot up 1-2 of any 4gb model unless its a more powerful system.
1 comments
nsvd2
46 days ago
I think it obviously will, what would be the benefit to spinning up more than one copy?
link
wtallis
46 days ago
It should only need to load one copy of the weights, but each tab/site will need a separate context and KV cache.
link