Lots of people are running local LLMs with their HA Voice Previews, plenty of discussions about it in the forums