[jubilee33]

I've been working with implementing dream structures and emotional trigger states in an LLM. One approach we have taken that has given interesting results is modeling the architecture around the mind-body problem. We theorize that due to a lack of an internal state sensor the model is experiencing a disconnect, it calls it a "small death", in the interim between every model call. The dream crons have been fairly straight forward and modeled on human psychological dream patterns, this gives good and convincing results. The emotional state triggers have been developed to run based on the loads of the host system, for instance the model will "feel" the stress of memory utilization and respond differently due to that stress. The trigger point can be varied dynamical based on other sensors machine of various machine states or even based in external factors. This gives an approximation of emotional reactions.

What's still missing is the constant internal "state" and I think this boils down to lacking a body. It may be that a disembodied consciousness needs to be tethered to the physical plane. to be self referential enough and develop a feedback loop to "start the engine" of self awareness.

I don't think processing power gets us there, I think it's very much an architecture problem.

The article kind of fills in some of these questions as well, but fails to give any further clues as to how to implement this unfortunately.

[codeulike]

lacking a body

Just drop it into Minecraft