Not necessarily. It's the specifics of the queries not the number of rows.
Which is why you measure before you optimize.