Alex was an applied scientist at Amazon and built distributed training systems during his time there. Given his experience, he methodically debunks several myths related to decentralized training. https://x.com/ai/status/1810332757807042738