As soon as you can build a probability distribution over possible states, you can use Monte Carlo like methods.