Hacker News new | ask | show | jobs
by _ea1k 455 days ago
Indeed. In 50 years, loading the weights and doing math should be much easier than getting some 50 year old piece of cuda code to work.

Then again, CPUs will be fast enough that you'd probably just emulate amd64 and run it as CPU-only.

1 comments

llamafiles run natively on both amd64 and arm64. It's difficult to imagine both of them not being in play fifty years hence. There's definitely no hope for the cuda module in the future. We have enough difficulties getting it to work today. That's why cpu mode is the default.