Hacker News new | ask | show | jobs
Pretraining Under Infinite Compute (arxiv.org)
3 points by jedharris 260 days ago
1 comments

"Our results show that simple algorithmic improvements can enable significantly more data-efficient pre-training in a compute-rich future."