Y
Hacker News
new
|
ask
|
show
|
jobs
by
nsvd2
37 days ago
I think it obviously will, what would be the benefit to spinning up more than one copy?
1 comments
wtallis
37 days ago
It should only need to load one copy of the weights, but each tab/site will need a separate context and KV cache.
link