Hacker News new | ask | show | jobs
by in-silico 72 days ago
Model-free RL doesn't mean you aren't training a model. It means that you aren't explicitly building a model of the environment's f(s,a)=(s',r) transition function, which methods like Dreamer do.

Q-learning only approximates the Q-value function, not the full state transition, so it is model-free.

1 comments

I know that... I didn't say Q learning is not model-free.

Do you seriously think a writer of that post would think model-free RL means "not training a model at all"?

> Dreamer

Especially when I later mentioned dreamer myself specifically as a model-based algorithm

> Site guidelines: Please respond to the strongest plausible interpretation of what someone says