Out of curiosity- there's a focus on local llm then talk about no GPU, only FPGA. Those feel- at odds. But maybe I'm out of the loop for how far local LLMs on custom hardware has come?
They're still at the compiler stage. LLM features and hardware seem far enough away that it's reasonable to wait to evaluate if that combination is actually practical.