What I mean is that we want something like set theory merged with weak computability theory (e.g. Kolmogorov complexity) but set means environment, embdded agent means element inside set, and then everything else gets built on top of that theory. This may be a an infinitely large -feeling work because there are many rules & interactions & games, but you are essentially answer what does it mean to be a rational embdded agent that's part of an environment, that probably doesn't have the exact same wants, in the abstract & formal sense of the inquiry.
Once you start examining scenarios where there are multiple clones of you that you perhaps cannot tell apart, your memory has been limited, you are facing larger amounts of pain & pleasure that you can handle without going insane, everyone wants the same thing but you also want something different, or someone gets mind-reading powers that might be partial and only work when they reveal their thoughts... then you are analytically working towards the end goal of building a larger catalogue of "everything" & making a theory & terminology out of that.
I would dedicate 2-20 years on the formal work but there's no funding I could get I know of & besides couldn't promise to yield results since foundations yields no results until it does if it ever does.
---
A related note: Kolmogorov complexity & finitism go along beautifully but the bit-lifting to calculate memory computational process takes insofar is out of my capacity. Nevertheless you can define a maximum number to ever allowed to exist in a system as Church number & have then perhaps the minimum amount of logical operations required to get there to be the maximum amount of memory your operations can take, closing the system since you lose memory in say substraction to a, b, the process initial size (hello, Kolmogorov) & process memory consumed at most (in any procedure, the smallest procedure being the number itself).
Once you start examining scenarios where there are multiple clones of you that you perhaps cannot tell apart, your memory has been limited, you are facing larger amounts of pain & pleasure that you can handle without going insane, everyone wants the same thing but you also want something different, or someone gets mind-reading powers that might be partial and only work when they reveal their thoughts... then you are analytically working towards the end goal of building a larger catalogue of "everything" & making a theory & terminology out of that.
I would dedicate 2-20 years on the formal work but there's no funding I could get I know of & besides couldn't promise to yield results since foundations yields no results until it does if it ever does.
---
A related note: Kolmogorov complexity & finitism go along beautifully but the bit-lifting to calculate memory computational process takes insofar is out of my capacity. Nevertheless you can define a maximum number to ever allowed to exist in a system as Church number & have then perhaps the minimum amount of logical operations required to get there to be the maximum amount of memory your operations can take, closing the system since you lose memory in say substraction to a, b, the process initial size (hello, Kolmogorov) & process memory consumed at most (in any procedure, the smallest procedure being the number itself).