These two pieces provide an overview of core building blocks to understand decentralized training, why decentralized training is interesting, and a spotlight on the three most significant movers in the space.

as i've grown older, i've felt that i've experienced an increasing amount of time dilation--not exactly in the definition that underpins the theory of relativity, but in the context of how time (as a distance) separates myself and friends that i see at more and more distant intervals.