[morrisjm]

rtx4000 only has 8gig memory which means reducing the batch size (much slowness) and/or how much text you can give it at once (meaning you have to break up text chunks not at sentence breaks)

rtx5000 maybe but not sure how much of a value improvement there is

[ShamelessC]

What is this, chatGPT? RTX 4000 is a series of cards, some of which have 24 GB of VRAM. There is no such thing as RTX 5000 series yet.

[morrisjm]

https://en.wikipedia.org/wiki/List_of_Nvidia_graphics_proces...

[dc443]

The commenter you're responding to is talking about Lovelace architecture based GeForce RTX 40x0 products. The Quadro line isn't even released yet on this architecture. You are talking about the specific Quadro RTX 4000 product, which is a TU104 (turing arch, 2 gens behind, with 2560 processors and 8GB memory). The commenter you're responding to is referring to something like a GeForce RTX 4090 which sports an AD102 (lovelace arch, with 16384 processors and 24GB memory).

You were merely an unfortunate casualty of Nvidia's product marketing scheme (and a commenter's slightly imprecise reference to it) here.

[ShamelessC]

I'm pretty sure we all lost heh. Thanks for clarifying. Indeed, there were slight errors in my description and the other commenter was reasonable in assuming those other cards were in discussion.