[iambateman]

If I was running in a server context, would the 50gb of ram be required to respond to one request, or can it be used to respond to multiple requests simultaneously?

[lolinder]

I'm very late to this question, but I believe that that amount is only required once, but the context tensor will need to be created per request. I haven't confirmed that, though.

[boredemployee]

I'd assume that all the calculations used for 1 request would already eat up that amount of memory, but I could be wrong!