|
|
|
|
|
by andoando
771 days ago
|
|
Ive tried making this exact product using all of these services, including using github repo koi is based on. They all use like 50% of my cpu to get real time. I was able to get actual low latency with koi, but still massive cpu usage. And theres no community of models for it either. Perhaps someone who really knows what theyre doing could optimize these open source models but its not me |
|
Could you share the repo?