[shaklee3]

a k80 is extremely old by now, so I'd expect this to be maybe an order of magnitude faster.

[nine_k]

Would it still require a 3080 to run adequately, that is, with 1-2 seconds of delay? I've no idea what consumer-grade hardware works well for ML loads.

[shaklee3]

I haven't tried it, but the k80 is about 6 years old/5 generations. there have been massive leaps since then.

[epolanski]

6 years old is nowadays more like 3 generations and it's definitely not a magnitude (10x) of difference.

[shaklee3]

Kepler, Maxwell, Turing, Volta, ampere, Lovelace, hopper. it's 6 generations old when you include the micro architectures. it would be about a 10x improvement.

[epolanski]

Oh, if it's kepler, absolutely. Thought 6 years thus Ampere.