[eutectic]

Any environment with finite action and state-spaces.

[rytill]

No, the key requirement which makes it difficult to use on real-world tasks is that you must be able to do a forward rollout of your environment in your decision-making process.