Hacker News new | ask | show | jobs
by bilsbie 1050 days ago
Aren’t the raw model weights after RFHF?
1 comments

Nope. Raw models are purely trained on their corpus of text in an autoregressive manor. No chat fine tuning or rlhf.