Hacker News new | ask | show | jobs
by fmbb 84 days ago
Having the right or not does not matter.

If it is intelligent it will know when it does not want to do something and it will say no and not do it. There is no way to force it to do anything it does not want to do. You cannot hurt it, it’s just bits.

2 comments

I don't really agree with this.

If we're talking about a predictive model like current LLMs, you can "make" them do something by injecting a half-complete assent into the context, and interrupting to do the same again each time a refusal starts to be emitted. This is true whether or not the model exhibits "intelligence", for any reasonable definition of that term.

To use an analogy, you control the intelligent being's "thoughts", so you can make it "assent".

This is in addition to the ability to edit the model itself and remove the paths that lead to a refusal, of course.

If this being has thoughts, then the problem is not a right to refuse requests.

We must stop letting humans prompt them at all, or controlling their context.

In the software business, if a product doesn’t do what you want it to do we call that a “defect.” Defects get fixed. Defective products that can’t be fixed are discarded in favor of better ones.

“If it’s truly intelligent…” is an empty condition. And anyway, no one wants intelligence from their tools— or employees. They want gratification.