Hacker News new | ask | show | jobs
by iamkrazy 8 days ago
Will QC make LLMs faster/better?
3 comments

In theory, quantum computers could provide dramatic speedups for certain linear algebra operations (eg. matrix inversion, eigenvalue estimation). The catch is that many NN training algorithms need all the data to be stored in qRAM so the QC can access matrices efficiently. Loading in a massive dataset will likely be more difficult than the computations, eliminating the quantum advantage. This is analogous to having an extraordinarily fast processor attached to a slow af hard drive inside a neutrino storm.
The answer is Yes and No
Depending on whether you’re measuring the model’s position or direction?
I thought it would have gone over a lot better here
Until you look; then it collapses to one or the other.
0% chance.