Hacker News new | ask | show | jobs
by vzaliva 104 days ago
Is it something wihch would make PS5 attractive to run local LLM models? I've heard Mac Mini shared CPU/GPU memory makes it popular for that.
2 comments
bigyabai 104 days ago
No, unified memory is not a panacea. The PS5 GPU is mostly raster-focused and doesn't have good acceleration options outside Vulkan compute.

Your best ~$300-400 option for inference is still the RTX 3060 AFAIK.

link
pantalaimon 104 days ago
The Mac studio also comes with up to 512GiB RAM.

The PS5 only has 8GiB.

link
Rohansi 103 days ago
The PS5 has 16GiB but your point still stands.
link