[ChrisCinelli]

I wonder why is much more expensive.

[GaggiX]

They would need to store and load the model, even if I imagine that they are using something similar to LoRA to finetune their models.

[swyx]

i would guess that the ideal price is also to raise the charge to make finetuning a last resort rather than a first resort; its probably much better cost- and research-wise if everybody just prompts the same model than silo off in their own minimodels.

[sebzim4500]

I don't think I'd consider it a 'last resort', since a lot of people will be choosing between finetuned GPT-3.5 and non-finetuned GPT-4, in which case finetuning is the cheap option.