Hacker News new | ask | show | jobs
by vczf 1002 days ago
I don't think it would know how to have a conversation if it's never been exposed to one before.
1 comments

That’s what the fine tuning is about. It learns the language, concepts etc. from the main dataset and is then tweaked by continuing to train on a smaller, high quality, hand curated dataset. That’s how it learns to generate conversational responses by default instead of needing a complicated prompt.