[sebzim4500]

I don't think I'd consider it a 'last resort', since a lot of people will be choosing between finetuned GPT-3.5 and non-finetuned GPT-4, in which case finetuning is the cheap option.