[programjames]

A good start would be:

1. Robust to adversarial attacks (e.g. in classification models or LLM steering).

2. Solving ARC-AGI.

Current models are optimized to solve the current problem they're presented, not really find the most general problem-solving techniques.

[stirfish]

I like to think I'm generally intelligent, but I am not robust to adversarial attacks.

Edit: I'm trying arc-agi tests now and it's looking bad for me: https://arcprize.org/play?task=e3721c99

[programjames]

"I like to think I'm generally intelligent, but I am not robust to adversarial attacks. I'm trying arc-agi tests now and it's looking bad for me."

One man's modus ponens is another man's modus tollens.

"I'm trying arc-agi tests now and it's looking bad for me. I am not robust to adversarial attacks. I think I'm not generally intelligent."

[stirfish]

I forgot what modus ponens/tollens are, but you get get it - I think I'm not generally intelligent

For people coming after me, or for anyone who took discrete math a decade ago and need a quick refresher:

Modus ponens (affirming): if P, then Q. P is true, therefore Q.

If it is raining, the grass is wet. It is raining. Therefore the grass is wet.

Modus tollens (denying): if P, then Q. Q is false. Therefore P is false.

If it is raining, then the grass is wet. The grass is not wet. Therefore, it is not raining.