[anonymous344]

i don't care about microcontroller, what is the decent option to have local llm in my raspi4 that does not take 30 seconds to answer?

[Rohansi]

Run a smaller LLM. It won't be as smart but the one shown here isn't either.