|
|
|
|
|
|
by mike_hearn
7 days ago
|
|
|
It's possible but it's not linear. A modern AI training cluster is a supercomputer that uses very different architectures and hardware to a bunch of small PCs connected via normal networking. The networking advantage alone kills any chance of decentralized training. |
|
|