|
|
|
Suggest a low-end hosting provider with GPU
|
|
6 points
by backend-dev-33
618 days ago
|
|
I want to do zero-shot text classification with this model [1] or with something similar (Size of the model: 711 MB "model.safetensors" file, 1.42 GB "model.onnx" file )
It works on my dev machine with 4GB GPU. Probably will work on 2GB GPU too. Is there some hosting provider for this? My app is doing batch processing, so I will need access to this model few times per day.
Something like this:
start processing
do some text classification
stop processing
Imagine I will do this procedure... 3 times per day. I don't need this model the rest of the time. Probably can start/stop some machine per API to save costs... [1] https://huggingface.co/MoritzLaurer/roberta-large-zeroshot-v2.0-c |
|
one NVIDIA T4 GPU, 16 GB RAM, and, this is an EC2 instance, it means "install anything" all this for $0.526 /Hour
do you see any hidden gotchas?