[jjcm]

As plenty of others have mentioned here, if inference were 100x cheaper, I would run 200x inference.

There are so many things you can do with long running, continuous inference.

[sipjca]

but what if you don't need to run it in the cloud

[ukuina]

You will ALWAYS want to use the absolute best model, because your time is more valuable than the machine's. If the machine gets faster or more capable, your value has jumped proportionally.