[billycao]

Thanks for the feedback!

We're working on fleshing out ToS, privacy policy, and company specifics, but just to answer your first question, I'm Billy Cao, an ex-Google eng, and Matt Baker is ex-Airbnb, ex-Meta.

Re: concerns, our infra will scale relatively well (several qps per model, probably), but we're still in the stages of fleshing things out and getting feedback. :)

Feel free to drop us a line at [e-mail] if you wanted to chat specifics!

- Billy

[langcss]

Thanks Billy!

Nothing specific... just wanted to get the feel. Out of interest are you bare metal or using AWS or something? Or both?

[billycao]

Appreciate the feedback! We currently use fly.io as our cloud GPU provider, but we're actively investigating other providers due to various limitations (like NVLink support).