Hacker News new | ask | show | jobs
by rfl890 244 days ago
How do we know this is accurate and not some big hallucination? Is the data sourced anywhere? Has anyone with a relevant background even skimmed through the code? It seems like a great idea in theory, but this execution is worrying.
1 comments
lleong1618 244 days ago
Yes, It's very much a "I wonder if this would work" and kinda did. to be taken in some what of a regard would be attaching a research agent on each commit.

I did spot checks on random files with research agents and it seems to be ok for a claude code loop.

I'm not a Dr'

Please! is anyone a DR

link
rfl890 244 days ago
I mean, it is a pretty cool idea, but trusting an LLM to correctly implement an entire human body in software is a recipe for disaster. There's bound to be tons of hallucinations and errors.
link
lleong1618 244 days ago
absolutely agree but for the purposes of working out what ALDH2 deficiency is and clicking through it was successful

should absolutely have a research agent or eyes on for hallucinations and errors

link
JumpCrisscross 244 days ago
> for the purposes of working out what ALDH2 deficiency is and clicking through it was successful

Does your code model acetaldehyde metabolism?

The exercise is an interesting proof of concept for a click-through model of a biological system. But it's also a warning for trusting LLMs for understanding.

link
lleong1618 244 days ago
no it didn't do click through for this metabolism at first but it read your comment and then added it I guess. "examples/acetaldehyde_metabolism.rs" its about to push this in a moment
link
JumpCrisscross 244 days ago
> its about to push this in a moment

The point is acetaldehyde metabolism is at the heart of your question: Why do some people flush red with alcohol.

Reading the first reference on Wikipedia's article about alcohol flushing [1][2] would have generated, I believe, more understanding about the biochemistry involved. (And the fact that ALDH2 deficiency simply exacerbates something we all do--acetaldehyde is a big part of what causes hangovers.)

What that would not have done is demonstrate (a) a genuinely interesting way to "step through" a physical system and (b) the ease with which a biochemist might be able to do so. As a hack and a project and a mode of communicating a model, I love this. Where I'm objecting is in pitching it per se as a mode for understanding a phenomenon, in this case, "what ALDH2 deficiency is."

[1] https://en.wikipedia.org/wiki/Alcohol_flush_reaction#cite_no...

[2] https://pmc.ncbi.nlm.nih.gov/articles/PMC2659709/

link