Hacker News new | ask | show | jobs
by FL33TW00D 1343 days ago
Excellent work - enjoyed the rick roll. Would you mind sharing how you've done the GPU deployment?
2 comments

lol, thanks! onnx, docker, and fastAPI on CPUs with AWS fargate. although i'm switching to GPUs in a month or two, so if you have any suggestions let me know.
I've also been searching for GPU solutions for potential small projects like this, and so far banana.dev and runpod.io seem promising.