Hacker News new | ask | show | jobs
by dr_dshiv 325 days ago
Like PHI — textbooks are all you need. You can create entirely synthetic yet high quality training data with a strong model (the generated textbooks) and make very small models like PHI.