[sabalaba]

Good choice on the 24 GB Titan RTX (so you can do at least batch size = 1 for Bert-Large). Not sure if that's the reason it was chosen though to be honest. If you want to do convnets only then you would do better with NVLinke'd 2080 Tis.

Secondarily, I would suggest that you guys not use windows but instead Ubuntu 18.04 or 20.04 LTS and just install Lambda Stack (https://lambdalabs.com/lambda-stack-deep-learning-software). It's a debian PPA that we maintain at Lambda to keep all of your deep learning drivers, CUDA, CuDNN, TensorFlow, and PyTorch up to date with just apt. It's free!

[mastazi]

Interesting! Is Lambda Stack going to work on 20.04? The link mentions only 16.04 and 18.04

[hughdbrown]

I've asked Lambda Labs 2-3 times if they are going to do an Ubuntu 20.04 stack, but I have not had a reply yet.

[sabalaba]

It works for 20.04 LTS and we've updated the website to reflect this, thanks for bringing it to my attention!

[sabalaba]

It works for 20.04. Sorry if you didn’t get a reply, I’ll look into it. Where did you email us?

[icelancer]

Been very happy with Lambda Stack at our company!

[mushufasa]

how does that compare to the pop_os! nvidia drivers, default on their downstream-from-ubuntu distro?

[proverbialbunny]

It's a bit more straightforward on Pop OS with two lines, `sudo apt install system76-cuda-latest ;; sudo apt install system76-cudnn-10.2`