[koheripbal]

Sure, but the real value here is the 65B. Can you have multiple GPUs on colab?

[arthurcolle]

I can't even get the 13B on colab to do inference with a very small sequence length.