[wewewedxfgdf]

Discrete GPUs are finished for AI.

They've had years to provide the needed memory but can't/won't.

The future of local LLMs is APUs such as Apple M series and AMD Strix Halo.

Within 12 months everyone will have relegated discrete GPUs to the AI dustbin and be running 128GB to 512GB of delicious local RAM with vastly more RAM than any discrete GPU could dream of.

[throwaway314155]

That seems a tad dramatic. GPU's were widespread because of gaming, not AI. That the overlapping market would somehow just all magically have >3,000$ _and_ decide to switch to a non-standard, non-CUDA hardware solution in just 12 months is absurd.

[lvl155]

FWIW GPUs still do not saturate PCIe lanes.