Hacker News new | ask | show | jobs
by larodi 4 days ago
Rillii ease eat? R U sure

https://en.wikipedia.org/wiki/Ablation_(artificial_intellige...

Have you read some (any) actual papers from the word this all and LLMs are?

Well here some:

https://arxiv.org/abs/1901.08644

Tis ablation ablation and ablation everywhere save for some kid’s fav. model names and their X pals.

2 comments

Papers using the term in their title or abstract: https://arxiv.org/search/cs?query=abliteration&searchtype=al...

Note that they're all talking about the same technique, namely applying ablation specifically to the refusal vector as described in https://arxiv.org/abs/2406.11717.

I really recommend letting this one go.

The very wikipedia page you're linking says:

> The term abliteration has been coined for the process of using ablation to uncensor large language models by modifying internal functions to completely eliminate refusal behaviors while preserving the remaining functions of the model. The word is a portmanteau that combines the words ablation and obliteration.

So are you dropping this now?