In the world of technology and computing, the term “modular” has become ubiquitous. But where does this concept originate, and how has it evolved over time? In this article, we will explore the history behind the “modular” concept, from Alan Turing’s modular Turing Machines to the current Large Language Models (LLM) that use “modular” techniques such as “mixture of experts.” We will also discuss the relationship between modularity and decentralization, a key principle in modern computing syst...