Hacker News new | ask | show | jobs
by b40d-48b2-979e 44 days ago
You don't know if the opinion is expert. You don't know who that person is or what credentials they even have. Blindly trusting something that sounds right is a terrible way to inform yourself.
6 comments

I'd agree more if MidJourney had decided to announce their product plans with a white paper instead of glossy 'product vision' marketing spin and virtually no information as to how they hope to solve the vast technical leaps necessary to convert the transducer chip they licensed from Butterfly's low-cost, handheld, pocket-sized USB ultrasound device into a contactless, 360 degree, 60 second full body scanner.

Given MJ's extraordinary claims and lack of detail, I thought the GP's response was well-calibrated, especially given MJ's unfortunate choice to lean into vaguely implying this has 'medical' utility, despite providing zero evidence (or even plausible theory) their approach could ever have diagnostic value greater than Butterfly's FDA-approved, handheld, full contact USB pocket scanner which is available now and plugs into a mobile phone. They are using 40 of the exact same transducer chip (designed for full contact use) from 200-400 times farther away. You can use the existing full contact Butterfly scanner today and just move it to 40 different angles. It would take a couple minutes longer, provide vastly greater resolution and is proven to have diagnostic value.

Bayes Theorem...the chances this rather milquetoast and balanced analysis was written by someone with no knowledge is vanishingly low IMO.
With LLM tools being widely available, it's extremely high, imo.
Idea for a website/documentary -- have experts respond to a piece of news, or provide commentary. Put a few expert pieces alongside a few LLM outputs, have people guess/work out which is which. Have the same people tell you why.

If on a website, rank the results; present the 'how I worked it out' info for the best spotters (and you could interview them). Keep the answers secret for a few weeks, then reveal them in a way that the game is still playable.

It's repeatable, every few months you could interview new experts (or the old ones again), get new models.

Kinda like the critical thinking version of images of a pelican on a bike.

I love your idea and would enjoy seeing the results of that controlled experiment.

I'm also interested in the broader impact of using LLMs in place of web search for general Q&A when we want 'to know things'. It's pretty clear the way LLMs are being used for knowledge acquisition now is often less accurate while 'feeling' more certain. Even if we set aside explicit hallucinations, I suspect it's still less accurate.

Hah, I'm neither a bot nor written with any help from an LLM, but I'll take the fact that you can't tell the difference as a compliment :)
It's not meant as a slight against you, but an observation on people blindly trusting Internet commenters in a time where our trust is (or should be?) at an all-time low for such content, so we should check our priors to ensure what we're consuming can be trusted and is verifiably true as LLMs exude confidently incorrect behavior.
I want to point out that you are posting from a 5-months old account (squarely within a time frame where LLM-powered accounts would be created), with an UUID-sounding username, claiming a 10-year-old professional history in the field, and using those credentials to bring up the possibility that a 14-year-old account claiming to be an MD with `md` in the username and _lots_ of comments is LLM-generated and asking for skepticism.

It's not particularly helpful; you could easily have done the 5 minutes of work.

Congrats, you've discovered people are always joining an anonymous platform, and some want pseudonymity? If I put "md" in my name, am I suddenly a doctor then? Your reading comprehension needs some work, I've been working for 16 years and it isn't being used as a cudgel to appeal to authority, but sharing some context about who I am and what my perspectives are.
Not taken negatively, and you're right. This is even more difficult with things that are opinion, and not clearly verifiable.
We don't know if any of the opinions on HN are expert for that matter. Yet somehow, it's survived and grown for 20 years.
"Blindly trusting" is not the same as "learning some new questions to ask about the validity of the given claims". The Midjourney announcement is not providing detailed medical credentials either.
they have md in the username