No Sublicensing or Distribution. Customer may not sell, rent, sublicense, distribute or transfer the SOFTWARE; or use the SOFTWARE for public performance or broadcast; or provide commercial hosting services with the SOFTWARE.
which seems to prohibit Vectordash's individual hosts from participating.
Ah right, hadn't seen that. Thanks!
If the vectordash team are reading, I'd make the nature of the service a bit clearer to potential users. There's no mention I can find outside the 'hosting' page that these aren't your machines.
If I understand correctly, the instances available are containerized instances that users run (i.e, the system matches hosts to guests and takes a cut).
Beyond being dangerous on multiple levels, there doesn't seem to be any guarantee of storage or network bandwidth/traffic. Having a multi-TFLOP GPU to train with is hardly useful if you can't get the training data on the device in a reasonable amount of time, or hold that data in local storage.
We ensure each instance has ample storage (min 50GB), internet speeds, and hardware specs such that the GPU is the bottleneck! If a user isn’t satisfied with an instance, then there’s no charge whatsoever :)
With more GPU-in-the-cloud offerings coming on line, is there a utility to dump GPU memory to see if your cloud provider has wiped it between customers?
Just read a pretty interesting paper on just this recently - we actually load/unload the drivers for every instance, which in turn also wipes the GPU’s memory. There’s a tool I wrote to test just this, albeit I haven’t uploaded it to GitHub yet. Might do that sometime this weekend.
[1] https://news.ycombinator.com/item?id=16002068