Hacker News new | ask | show | jobs
by AtlasBarfed 264 days ago
"automated experimentation so it's able to generate new types of data to train itself"

AIs don't understand reality. This type of data generation would need a specific sort of validator function to work: we call this reality. That's what "experimentation" requires: reality.

We already have this right now, with the AI training ingesting AI crapgen, with StackOverflow posts no longer happening. That would seem to point to a degrading AI training set, not an improving one.
2 comments
DocSavage 264 days ago
A number of startups are working in verifiable domains where they can provide realistic data. This is an interesting thread from one of those startups: https://x.com/khoomeik/status/1973056771515138175

Here's a discussion with Isomorphic Labs (Google DeepMind spinoff) on this line of thinking: https://www.youtube.com/watch?v=XpIMuCeEtSk

link
ethagnawl 264 days ago
Side note: I happened to look at the SO "Community activity" widget earlier this week and was quite surprised to see just how far engagement has fallen off. I don't have historical entries to reference but I'm _fairly certain_ there used to be hundreds of thousands of users (if not more) online during the middle of an average work day (I'm in America/New_York) and there are currently ... 16,785.
link