Hacker News new | ask | show | jobs
by alfiedotwtf 1 day ago
I don’t k ow what I’m doing wrong. Everyone says ds4 is faster than a lot of models around the same size, but I’m getting 2t/s with DSv4 vs 12t/s with Minimax 2.7 (16Gb 5080 + 16gb 5060ti + 128gb ram).
1 comments

ds4 is optimized for systems with unified memory. it works best on apple silicon with 96GB+ of RAM
ah! ok, now that makes sense. Thanks for that.