[ACCount36]

LLMs are already capable of complex behavior. They are capable of goal-oriented behavior. And they are already capable of carrying out the staples of instrumental convergence - such as goal guarding or instrumental self-preservation.

We also keep training LLMs to work with greater autonomy, on longer timescales, and tackle more complex goals.

Whether LLMs are "actually thinking" or have "volition" is pointless pseudo-philosophical bickering. What's real and measurable is that they are extremely complex and extremely capable - and both metrics are expected to increase.

If you expect an advanced AI to pose the same risks as a faulty thermostat, you're delusional.