Hacker News new | ask | show | jobs
by oac 396 days ago
It runs a model with 260K params, so hardly a "Large" LM. Nevertheless, a cool project.
1 comments

And also not exactly a Commodore 64 is it, since it requires an addon with 30x the RAM. Still very cool and impressive though!
It's a borderline thing. The official Commodore REU only supported 8x the RAM. But you could modify it yourself to 32x. Creative Micro Design also had the third party 1750 REU which supported 32x RAM. (2 megabytes.)

So it is somewhat period accurate, albeit very expensive at the time.

Imagine if someone had run that LLM on that hardware in the 1980s, though. Incredible!

(Probably couldn't have trained the model, but still.)

You'd have needed a ZX Spectrum for that!