|
|
|
|
|
|
by phantompeace
30 days ago
|
|
|
Considering the very small difference between just SFT on the student model as compared to SFT + DPO on a proxy, doesn't it make sense to concentrate on ensuring the SFT dataset is perfect rather than sorry about DPO etc? And just train directly on the student model? |
|
|