[wmf]

Sure, LLMs can eventually simulate anything in a lossy, ridiculously inefficient way. It's not a good idea though.

I'm somewhat reminded of the paper "Could a Neuroscientist Understand a Microprocessor?" which calls out the weakness of black-box analysis and simulation techniques. https://journals.plos.org/ploscompbiol/article?id=10.1371/jo...

[GianFabien]

LLMs can only re-mix what already exists on the internet. If copious amounts of information doesn't already exist on the internet about specific subject matter, then at best you'll get some great sounding nonsense.

[wmf]

Yeah, I'm assuming "simulate a chip" means the LLM would be trained on a ton of documentation related to the chip. Otherwise you'd have no chance.