If your problem's domain is not too big then you are basically right, but in practice things are more complicated, larger, noisier, etc. I am conflating many things here of course.