Hacker News new | ask | show | jobs
by nc 1116 days ago
It would as open source improvements would start to exceed performance of 3.5 for specific use-cases. At the very least they would have to make it fine-tunable.
1 comments

Sam Altman said recently that they are already working on making GPT-3.5/GPT-4 finetunable, they are just limited by the availability of compute (partially since none of their SFT infrastructure uses LoRa).

I had previously assumed it was safety concerns, since I don't see what stops someone from finetuning away all guard rails.