Hacker News new | ask | show | jobs
by mensetmanusman 2365 days ago
I had the thought of how obfuscating this technology could be to hide information. Imagine this going off and publishing an unlimited number of images with generated descriptions that are indistinguishable from what a human would do. There would be no way to verify what the correct information is if you are someone just casually searching the Internet. (This could also almost apply for any type of information...)
2 comments

-> https://thisrentaldoesnotexist.com

All of the dynamic content on each listing is generated via a series of different machine-learned AI models.

"The laundry are converted into a mini central heating for every guest."
I've found that creating Markov chains are more human feeling (but maybe a bit overfit) if I use a n[0]-level deep look ahead for my generators.

[0] where n is normally 2 or 3

Yeah, the listings on this page don't quite make it up to a human level of coherence:

"Thus serve a 24 hour security pournising. Also hype is requested as much as you please empty and have a prestige less um be restriction, day or night."

It's close, though! But maybe not close enough for people to worry -- the last 10% of the security pournising always takes 90% of the development time.

“there will be a BREAKFAST Walk into the block in the room”
If that was going to be a problem, people would already be generating fake numerical data like material properties, physical constants, statistics, or whatever that's also subtly wrong. You don't need machine learning to do that.

This fear of fake information from ML misleading everyone is ridiculous and kind of arrogant. It assumes that the world is full of "other people" who are too stupid to make decisions for themselves and usually concludes that "us smart people" have to somehow control what they see to protect them from themselves. We've had fake information since forever and we've developed systems to deal with it. Citing sources, trustworthy organizations, multiple sources agreeing with each other, people pointing out mistakes, Google favoring popular sites, confirming it yourself, etc. Some fake information still gets through and it is a problem but it already happens and the world keeps turning. For casual internet searchers who don't care how reliable their information is, let them believe whatever nonsense satisfies them. They aren't trying to be right, they're just entertaining themselves.

I agree that "we must control others" is a bad approach. But I think you're underestimating the problem. Fake news has a body count, and it will only get worse: https://www.wired.com/story/how-whatsapp-fuels-fake-news-and...

At the very least, I think we need to train people in a lot more media literacy. But traditional approaches to that rely on media being scarce and expensive to create, which gave people enough time to carefully vet what they were consuming. As it becomes cheaper to create media than to vet it, we'll have the same problem as spam: it'll be impossible for humans to effectively filter it manually.

I think the real solution is automated vetting tools, so no information is presented without provenance. Basically, any time somebody sees an image or a video, there should be a link that lets you find out about the source, the editing, and who, specifically is vouching for it. And warnings for things that lack that. That still gives the viewer agency, but brings the problem back to human scale.