Hacker News new | ask | show | jobs
by 3abiton 391 days ago
This is such a fun project! I am curious about the hardware used? Or is the LLM hosted on a remote server?
1 comments

Hey! It's fully local, I was trying to build it privacy first. All the things related to kids are very sensitive, I didn't want to send anything to cloud.

But you can still run the inference remotely, changing that should be just a matter of changing the address.