[matthewdgreen]

I wanted to download and local LLMs on my Macbook, but discovered that I just didn't have the RAM for this. Moreover I couldn't upgrade to handle the new use case, I'd need a whole new Macbook. But the cost of that new machine would be absurd.

To be clear I have no problem paying the Apple tax, the computers are worth it. The problem is that Apple has optimized the Apple tax in such a way it makes local AI applications impossible, which is a shame because they have such the best architectures for that use case.