Hacker News new | ask | show | jobs
Show HN: Self hosting a modern LLM stack (github.com)
5 points by sleepynoodle 33 days ago
1 comments

Have you tried running really large models with this? And how are you managing allocating resources ?