[bryden_cruz]

Running a rack of 3090s in your garage to avoid provider lock-in/costs is the most Hacker News thing. Out of curiosity, what are you doing for uptime/failover? If you are running production traffic to that garage rack, does your app just degrade gracefully if your home internet drops, or do you have a cloud fallback?

[mips_avatar]

Yeah the model i'm running locally is just one of several models the app supports and it falls back to others if not available.