I've been reading up on various Distributed Training research endeavors. Inspired by @, here is what I have come across. https://x.com/ai/status/1843719983899230432 /ai