|
|
|
|
|
|
by robkop
66 days ago
|
|
|
You can ablate surprisingly large chunks of a model with near to no effect, you can try this easily - download an open weight model in torch. Obviously it’s not ideal but you could likely have single digit % of all weights affected and still have a useful model (many caveats here: e.g. locality of damaged weights matters, distribution of errors matters, fail high/low matters, …) |
|
|