Hacker News new | ask | show | jobs
by justanotherjoe 29 days ago
At one point you just have to look at a mirror and ask, what would impress you.

Also why pay anyone, when they can keep up with all the papers that not one man can read them all? That seems to me like wasted money.

Another point is that that's not how AI training works anyway. It's much easier to put it in context rather than re-train them with every bit of random maths you find out. Things at the tail-end of the power law doesn't stick. At least, last I checked...

1 comments

The opening line of my parent comment is: "This is impressive, no question." I am impressed, and the chain you are replying to is questioning how much that impression should be tempered.

They pay people for expert training data they do not share because it gives them an edge over other AI companies. And, as always, deep learning is enormously data-hungry, and we've gotten to the point where publicly available data has been exhausted.

AI companies absolutely retrain models regularly to keep up with the cutting edge. There is a reason why this announcement references an internal, unreleased model, rather than "we just put a lot of new math papers within the GPT5.5 context window and found this."