Look around the room right now. What do you see? Patterns of light resolve into objects: your screen, a cup, a book, a desk. You don’t think much about it because you don’t have to, it's automatic. That’s really the whole the point of perception: to distill the chaos of the world into something actionable. You don’t need to analyze every photon or angle of light. You just need to know there’s a cup, so you can reach for it and drink. No surprises.
This act of seeing, how we go about trusting the scene in our mind's eye, depends on layers upon layers of pattern processing of which we are blissfully unaware. From the retinas in our eyes distinguishing wavelengths of light to the visual cortex detecting edges and building shapes, our minds are performing immense pattern recognition and pulling it into a scene. Our minds do it so well that we just see the world as if it’s “out there,” even though all of this happens between our ears. Close your eyes, it mostly disappears.
It's crazy that this isn't more apparent, but the world we experience is not the world itself, it is a representation of it in our minds. We experience a world "out there" even though what is "out there" is inside, filtered, compressed, and re-presented to us as observers. Eastern mystics may say the world is an "illusion" and it sounds rightly profound, yet it isn't an illusion so much as a really good representation based on these filters. Like Plato's cave, the shadows we see are interpretations of reality, not reality itself.
We arrived htere because whether or not these representations are “true” is far less important than the fact that they are useful. Our systems evolved for survival, not accuracy. Survival isn't helped when we treat the world as illusion. Survival dictates we treat the vision as real. If it sounds it looks like a lion in the bushes, best to be on the side of caution, even it its just a rustling branch.
Today, as we teach machines to “see” and act in the world, we are beginning to understand just how layered and complex this process of perception really is, just how much our representations determine not only what we see, but what we see in ourselves. We have an intimate relationship between ourselves and our representations. But it goes much deeper.
It is really impossible to define a pattern without an observer to the point we can't even be sure one exists. Can we say an observation exists without an observer? The tree in the forest may not, in fact, make a sound unless there is someone to hear it. This may seem like semantics, but this basic idea is starting to have repercussions across science beyond just quantum mechanics.
The word “pattern” originates from the Latin patron, meaning protector or guide. Why? A patron is a model of society to emulate, similarly a pattern is a model, but more of the sense of an abstraction, a core set of similarity across individual occurrences.
We might say a pattern guides us away from uncertainty and toward predictability. A pattern is many ways is a prediction. Patterns repeat and thus have some level of predictability to be useful. They are regularities in the world that can be described more simply than listing all of their elements, from a model of society to an equation that predicts the trajectory of a ball in flight. Patterns simplify, compress, and guide action that can be quick when a pattern becomes more recognizable.
The Greeks had a word for this too: idea (ἰδέα), meaning form or pattern. Plato’s ideal forms were thought to be the purest patterns—mental representations of perfect objects. Once again, patterns link to representation. But here lies a chicken and egg problem, which came first, the pattern or the pattern recognizer (aka the observer)?
Patterns require observers. Without an observer, something capable of detecting regularities, the world contains far too much information to be valuable. There are a couple of related concepts of combinatorial explosion and computational irreducibility. Essentially, any slide of the world you try to take, you'll have way more information than it is possible to analyze, so we must take only abstractions or compressions. Observers filter and compress raw information into meaningful patterns. If an observer could process everything, it would be as large and complex as the world itself. It would cease to be a distinct “observer.” Observers, as they are by definition a part of the universe and a subset of it, are not just constrained by, but are defined by computational bounds.
This is the paradox: observers must be computationally smaller than the systems they observe, yet try to make sense of a world much more complex and vast than they are. They can only interact with a limited slice of reality, so they must filter. This act of filtering is what creates patterns. Without a filter, there is no pattern defined.
Without compression, there is no observation. Without observation, there is no pattern.
Most know about the Observer Effect, where the act of measurement affects the outcome in quantum mechanics. Yet science is just coming around to the idea that the act of observing is never passive. An observer is always engaged in selecting, compressing, and abstracting information.
IIt’s true of all observation:
The eye detects light waves and compresses them into shapes.
The mind abstracts those shapes into objects.
We act on those objects, trusting that the patterns we’ve detected are reliable.
We find idealized shapes based on abstracted similarities, like the Platonic Solids.
It’s so seamless we forget we’re doing it. But this process of 'observation, compression, action' is the foundation of how any bounded system interacts with its environment.
So it may be starting to become obvious, but patterns can only be detected by other patterns. To observe a regularity, the observer itself must exhibit a kind of regularity, a structure tuned to recognize specific inputs. Your retina detects patterns in light because it evolved as a biological pattern recognizer. A neuron fires because it “sees” a particular input as significant. Facial recognition systems identify faces because they’ve been trained on patterns of data.
Which brings us back to the chicken-and-egg problem: where did the first patterns come from? How did the first “observers” emerge to detect anything at all?
To answer this, we must look for the simplest possible observers, systems so basic they border on the definition of existence itself. Stephen Wolfram suggests that simple nodes and rules in his computational universe, akin to cellular automata, might be the first pattern recognizers. For instance:
Node A gives rise to Node B.
Node B gives rise back to Node A.
This simple alternation is a pattern. It doesn’t require an advanced observer to “see” it—existence itself generates regularity. From such primitive processes, more complex patterns and observers can emerge. Observers detect patterns, compress them, and validate them. Trust in those patterns allows them to expand their scope—their “context windows”—and recognize more sophisticated patterns. For more on Wolfram and Observer Theory from a computational perspective, check out Wolfram Physics and his article on Observer Theory.
Interestingly, even time itself may emerge from this process. Time, as we perceive it, is not an independent reality but a byproduct of observing causal patterns. Without patterns to observe—no change, no sequence—there would be no perception of time.
Observers are necessarily finite. They cannot perceive all interactions at once, so they observe sequences instead. The “arrow of time” may simply reflect the order in which a bounded observer detects patterns in its environment.
As we build artificial systems to recognize patterns, we see these principles in action. Modern AI models like Large Language Models (LLMs) or knowledge graphs are designed to compress and abstract vast amounts of data into representations.
LLMs compress linguistic patterns to generate coherent text.
Knowledge graphs link concepts and relationships to create high-level representations of information.
Yet, AI is still a bounded observer. Its ability to detect patterns is limited by computational resources, training data, and design constraints. Like us, it sees a subset of the world, compresses what it can, and trusts the patterns it has learned.
This brings us full circle: patterns require observers, and observers are bounded systems navigating a chaotic world through the act of compression.
The Observer Paradox reveals something deep about existence itself: the ability to see, know, and act depends on the ability to compress reality into manageable patterns. Without computational bounds, there would be no observation, no pattern, no time—no anything as we know it.
We are participants in this recursive process, much like AI systems and the simplest rules governing particles or nodes. The patterns we see are shaped not just by the world but by who and what we are as observers.
As we explore this further—across physics, biology, cognition, and artificial intelligence—we will find that the act of recognizing patterns is not just a human feat. It is a universal principle of existence, repeated at every scale.
The question then becomes: How far can this recursion go?
We may think of order and entropy/chaos as opposites, but actually causality and entropy that are opposites, yet two sides of one coin. Causality is just order in motion.
Order through time.
If you mix random ratios of gas long enough, they’ll be distributed fairly evenly. Seems ordered to me, despite the increase in entropy values…
When you get to into definitions of “order” it’s about how well details can be summarized by some other means. The more stares that are equivalent, the more entropy. If all gas molecules are ordered into a cube in perfect alignment and static, that’s easy to describe and ordered, if they are randomly bouncing around the container, that’s high entropy with nearly infinite equivalent ‘states.’
What do you think is the biggest mystery in science? I have two which are related: • Why is there something rather than nothing? • Why does that something continue in a causal fashion? This cast inspired by this podcast with Lex Fridman and Adam Frank: https://www.youtube.com/watch?v=nSz0R_S4QMk
Favourite atm is “how much time was there before the Big Bang?” It relates to the notion of ‘time’s arrow’ - I met the professor here at MIT who came up with the theory (he was ofc initially ridiculed) He’s now teaching an experimental course on time travel.
/microsub tip: 126 $DEGEN
✅ 126 tipped ∙ 127 remaining 407 / 534 (76%) 🟧🟧🟧🟧🟧🟧🟧🟧⬜⬜
The first one for sure.
The discussion about artificial intelligence and consciousness is very interesting. Adam Frank suggests that artificial intelligence has no possibility of possessing consciousness. If artificial intelligence doesn't gain the ability to exist in an artificial reality where it can sense its environment, how could it develop consciousness? If creating a virtual world is possible, then it's likely that AI consciousness could emerge through these experiences. The virtual world doesn't even have to resemble our own—we don't know if "our creator" is, perhaps, outside the box in which we exist. It's theoretically possible that we are part of a data carrier with computational power, enabling us to perceive everything around us. Our creator's world could be completely different, and our world might be solely their creative idea. The same could happen with AI given sufficient scientific advancement. This, of course, is just a theory that has puzzled me since childhood.
Also, why consciousness? Everything could run within the universe exactly as it does, both deterministically and biologically, without any need for beings to be aware of it. And yet we are 🤷♂️
Causality is perhaps a human construct. Check out Wolfram on observer theory. https://writings.stephenwolfram.com/2023/12/observer-
Yeah I generally like Wolfram a lot but his OT doesn’t move the needle for me. It’s fairly hand-wavy imo. It’s at least a refreshing take but if true ( based on my understanding) it would essentially negate all of science by minimizing it to be meaningless (aka “science works because science works”).
“Because” Be cause When asking about the cause of causation, yeah it’ll get circular, Godellian perhaps. But yeah needs more formalization. Still new. Not sure i’m the one to do it, but working to make some sense out of it. Recursive pattern compression is adaptive in all kinds of systems.
This is what I’m writing about at /mirror-loom Join in! https://paragraph.xyz/@mirrorandloom/the-observer-paradox
A more important question to me is what qualifies something as something as opposed to being nothing?
Quick thoughts on a top 12 reading list, keeping here as bookmark: Godel, Escher, Bach The Mystery of Capital The Master and His Emissary Brief History of Intelligence Anti-fragile and Fooled by Randomness The Book of Why Why Information Grows The Origin of Wealth The Information A New Kind of Science The Remembered Present Flow
A few more: A thousand Brains Complexity
Great list! Bookmarked
Thanks @maurice these are books related to the book I'm writing and will be referencing. This channel is about that book. Be sure to check out my first post as primer, I'll try to keep them coming weekly... https://paragraph.xyz/@mirrorandloom/the-observer-paradox
@azbest just staked $impact on @hyp's cast. Support @azbest's nominees by subscribing to auto-fund their curation. Opt out of /impact nominations in frame
Introduction to some of the key points I'll be diving into. https://paragraph.xyz/@mirrorandloom/the-observer-paradox
Are we just a pattern? Of patterns? https://paragraph.xyz/@mirrorandloom/the-observer-paradox
The people at Qualia Research Institute are traversing similar territory, you might want to check them out and get in conversation to battle test your ideas. It's also interesting to observe that Buddhism speaks of this paradox through the lens of dependent origination, and you might find more there too. Good luck with the book!
I’m pretty much a Daoist and you’ll notice the “original pattern” is pretty much a yin-yang, so yes. Also familiar with co-dependent arising. 😀Complexity at Santa Fe Institute also crosses similar bounds. Will check out Qualia but honestly want to steer clear of consciousness question even if i think this might be a better lower level, axiomatic model than IIT.
What's the intention in your work?
I've got some Taoist leanings as well, the yin yang (taijitu) symbol is astonishing. Periodicity, the center or maximum of yin contains yang and vice versa, bounded only by it's own dance (and unbounded as merely a representation of the Dao that cannot be named). Itself generates more, you can find the 4 fundamental forces within it: peng, lu, ji, an-correleate with some imagination to the four suits of playing cards and also strong, weak, electromagnetic and gravity. There is a whole thing that takes this and generates movements that reflect this Cosmic system internally, the alchemy of the 13 Original Postures of Taiji.
Interesting piece, thank you for sharing! 🤍 Is the final question rhetorical? Because what comes before seems to suggest that there is no end to recursion. My intuition is that the limit is only that which we are able to perceive. 100 $degen
Spot on! No, not rhetorical exactly, more of a lead-in to the next parts I'll be putting out. But I agree and plan to go into your point. There are limits to human understanding (going back to origins of patterns) and probably to understanding at upper level as well (how far computation or any kind of AI can get us)
Thanks for reading!
Title drives at your question: "The mirror and the loom" refers to a key imagery from Alfred Lord Tennyson's poem "The Lady of Shalott," where the Lady is forced to observe the outside world only through a mirror and then weave what she sees onto her loom, symbolizing her isolation and inability to directly experience reality due to a mysterious curse; the mirror represents her restricted view, while the loom represents her artistic expression through weaving these reflected images.
Said curse sounds like the nature of being a woman in Victorian times—nothing especially mysterious about it! Can't say I'm much of a Tennyson reader, but I love the rich symbolism you describe here. Feels like a Jungian take on Plato's cave allegory! More seriously, it's a terrific title.
Another vacation, another chapter
Once you finish, hubs will just be one strange loop!
too bulky 😭
I read this book after high school (was in an unfortunate place in life) and it (among like 2 other events) changed the course of my life. I enrolled in a Math program and spent the next 4 years expanding my horizons. Still have my copy. It's travelled with me over the decades.
I hate that book. Honestly could be 20 pages
Agree. Found that book so boring. Picked up incompleteness around the same time and thought it conveyed the most important ideas in a much more efficient way. This was in high school though so might be misremembering.
If you write a 20 page summary I’d read it
@eulerlagrange the type of person that plays his music at 2x speed
I don’t have time to waste for this flowery bullshit
“I am a strange loop” is meant to be that compression It was entertaining
It's 363 pages though.
Enjoy the vacation!
https://warpcast.com/aviationdoctor.eth/0xa34b73a1
Yeah :( I don’t I’m brave enough
I like the chapter that reads forward and backwards (line by line) with different meanings
Every chapter is an universe in itself. Do keep casting about it. ❤️ This book altered me in so many ways that now I see my life in 2 halfs pre-GEB and post-GEB. 🙈 https://warpcast.com/kpx/0xcdcf0011
I’ve started this five or six times in my life Absolutely cherish my copy Can’t see that I’ll ever finish it But I hope to What a remarkable book
Thats how I read it too. And honestly, I think there’s value in reading it that way, so the brain can process it in the background somehow. In a sense, I’ve come to love the book this way and have enjoyed it more by not rushing through it.
Do not miss the forest for the trees
love this, one of my favorite mantras and something i have to remind myself of often
Trees: ↑↑↑↑↑↑↑↑↑↑↑ ↑↑↑↑↑↑↑↑↑↑ ↑↑↑↑↑↑↑↑↑↑↑ ↑↑↑↑↑↑↑↑↑↑ ↑↑↑↑↑↑↑↑↑↑↑ ↑↑↑↑↑↑↑↑↑↑
I wrote a post on this. https://paragraph.xyz/@mirrorandloom/the-observer-paradox
it's the water you swim in
all about seeing the bigger picture
tag ... you're it...
i am 😂😂😂
definitely vlady!
https://paragraph.xyz/@mirrorandloom/the-observer-paradox
Moving up….
deserved. you rock
Thx fren 333 $degen hey here’s some of my project taking shape: https://paragraph.xyz/@mirrorandloom/the-observer-paradox
Lol my rank is so high I can't even see it
It doesn't show my rank, how can i see mine?
grats bro!!
Some relevance for seekers... A New Observer Paradox
A+ stuff Here! As I was reading, the concept of the atman (sp?) Popped in my head, as I recall it's akin to The Observer, but distinct from the person or ego or the Thinker. If as you question this recursive process gives rise to time, then human discovery of spacetime/4D brings in a level of Strangeness, a time static perspective, in which observation as so formulated can't exist ( I think, typing as I chew in this)
I don't think time is a separate dimension. I like Wolfram's formulation that essentially "reality" is constantly being updated, say, like a Turing machine. point by point. but they don't necessarily happen in the perfect temporal order. We however, our survival depends on a single line of time, so our perception stiches things into that single line of time. He says that's why we get quantum effects, essentially.
Hmm. Time gets difficult to think about. I think of the statelessness of LLMs, in what ways is their observation alike/dissimilar to ours. But their relationship to language may be different than ours, and language does some reality creation that may or may not be purely computational. I've been approaching these questions from Wittgenstein (and lately I guess complex systems, but that only as much as needed to understand what Llms tell me I've been up to). But I've had some good results by trying to contemplate things from that 4d perspective