[someone13]

What hardware do you use, out of curiosity?

[jychang]

In the current era of MoE models, the system RAM memory bandwidth determines your speed more than the GPU does.