[ftufek]

> Also: Almost everyone using GPUs for work will join NVIDIA's Inception program and get rebates... So why look at retail prices?

Out of curiosity, does that also apply for consumer grade GPUs?

[chrisMyzel]

you can get RTX/A6000s but not 3090s or 4090s via inception.

[lostmsu]

Prices? Prebuilt workstations? Or should we just apply and see, is that easy?

[fxtentacle]

Companies with 4+ employees only.

[lostmsu]

FAQ says 1 developer.

[fxtentacle]

The client I work with can order 3090 TI and 4090 through their Inception link (in Germany). Apparently, it varies by partner.

[tambre]

I would be surprised if it did. But you probably shouldn't do professional work on GPUs that lack ECC memory.

[nl]

The lack of ECC memory is almost certainly not a factor. If you can train at FP8 your model will recover from a single flipped bit somewhere.

[Loranubi]

I mean you could even view bit flips as a regularization technique like dropout...

[dahart]

Yeah I hear it’s common practice now to avoid synchronizing GPU training kernels in order to speed things up, and it has positive regularization benefits and little downside.