Hacker News new | ask | show | jobs
by x0x0 3876 days ago
distributed ml tends not to work well on aws. Many (most?) distributed ml algorithms are essentially limited by network speed. In a p2p topology, many are effectively limited by the slowest peer-to-peer link of the (nodes choose 2) links. aws networking is mediocre at best; even the rack-local instances are relatively slow.

cred: helped build a distributed in-memory ml toolkit