[throwaway314155]

The other main caveat is that installing from custom sources using apt is a massive pain in the ass.

[koakuma-chan]

I tried running an LLM locally today, installed cuda toolkit, and it was missing cudann.h

I gave up.