<?xml version="1.0" encoding="utf-8"?>
<rss version="2.0" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/">
    <channel>
        <title>Continuations</title>
        <link>https://continuations.com</link>
        <description>Heading towards the knowledge age</description>
        <lastBuildDate>Fri, 20 Nov 2026 20:43:03 GMT</lastBuildDate>
        <docs>https://validator.w3.org/feed/docs/rss2.html</docs>
        <generator>https://github.com/jpmonette/feed</generator>
        <language>en</language>
        <image>
            <title>Continuations</title>
            <url>https://img.paragraph.com/cdn-cgi/image/format=auto/https://storage.googleapis.com/papyrus_images/e3f4eb1044178c979fd42b642565dbab.jpg</url>
            <link>https://continuations.com</link>
        </image>
        <copyright>All rights reserved</copyright>
        <item>
            <title><![CDATA[Democracy and Remaking: The Case for Sortition]]></title>
            <link>https://continuations.com/democracy-and-remaking-the-case-for-sortition</link>
            <guid>tb30n1lHusutsBiB1k15</guid>
            <pubDate>Wed, 18 Nov 2026 23:04:46 GMT</pubDate>
            <description><![CDATA[The industrial age is over. Our calling now is to invent the age that comes next. Doing so requires nothing short of a complete remaking of the industrial age systems that currently control us, such as the education system, the social security system, the tax code, the healthcare system, etc. The required degree of change poses a unique challenge to present day democracies which have been focused on stability. So far they have failed to rise to the occasion which has resulted in deteriorating...]]></description>
            <content:encoded><![CDATA[<p>The industrial age is over. Our calling now is to invent the age that comes next. Doing so requires nothing short of a complete remaking of the industrial age systems that currently control us, such as the education system, the social security system, the tax code, the healthcare system, etc. The required degree of change poses a unique challenge to present day democracies which have been focused on stability. So far they have failed to rise to the occasion which has resulted in deteriorating political and social landscapes in much of the world. Unsurprisingly then we are once again hearing calls for authoritarian approaches of varying guises, some are outright backward facing (e.g. calling for aristocracy), while others point to the success of China, and yet others imagine handing over these decisions to AI.&nbsp;</p><p>In today’s post I want to make the case for an alternative: A return to sortition as a democratic means of remaking.</p><p><a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://en.wikipedia.org/wiki/Sortition"><u>Sortition</u></a> was a core element of Athenian democracy. Sortition is the random selection of citizens to fill a position or form a deliberative group, much as we still do in the US today with juries. Athenians considered this to be superior to elections, because elections allowed the wealthy to purchase influence, a profound insight that we sadly appear to have forgotten. Athenian democracy required candidates that were selected to submit to an examination (<a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://en.wikipedia.org/wiki/Dokimasia"><u>dokimasia</u></a>) to ensure their qualifications. There was also a process of accountability (<a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://en.wikipedia.org/wiki/Euthyna"><u>euthyna</u></a>) after leaving office.</p><p>I am far from the first person to propose a return to sortition. For instance, Astra Taylor mentions this as a possibility in her book on <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://bookshop.org/p/books/democracy-may-not-exist-but-we-ll-miss-it-when-it-s-gone-astra-taylor/421466c1f2f9d086?ean=9781250231284"><u>Democracy</u></a> and David Chaum made a <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://web.archive.org/web/20160109174044/http://rsvoting.org/whitepaper/white_paper.pdf"><u>proposal</u></a> on random elections in 2012. I believe we need it now more than ever because it has become abundantly clear that the present political systems are not up to the task. In the US, neither Democrats nor Republicans will ever have a sufficient mandate on their own to accomplish the degree of necessary change to the existing systems.</p><p>A recent example of sortition in action comes from Ireland. The country had a very restrictive policy as part of its constitution, which allowed abortion only in cases where the life of the mother was at risk. The Irish parliament put in place a <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://en.wikipedia.org/wiki/Citizens%27_Assembly_(Ireland)"><u>Citizen’s Assembly</u></a> of 99 randomly selected citizens (i.e. citizens selected by sortition). The citizens decided in favor of repealing the constitutional amendment and allowing parliament to legislate. This was then put to a vote of all citizens and approved as the new policy for the country with broad support for the change to the constitution.</p><p>We should avail ourselves of this mechanism to remake our major systems that are in dire need of change. We could have separate groups for social security, taxation, healthcare, education, immigration etc. Ideally the groups are selected and meet at the same time as these policies are all interrelated. For example, the introduction of basic income to replace existing social safety nets could come in the form of a negative income tax.</p><p>The path to this in the US goes via <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://en.wikipedia.org/wiki/Article_Five_of_the_United_States_Constitution"><u>Article V</u></a> of the constitution, which allows for amendments to the constitution and can be triggered by 34 states (and much less likely by a two third majority in both houses). A possible amendment could call for a one time reset of major policies through citizens assemblies letting regular politics resume after these have been agreed upon. Crucially it would have to insist on sortition to prevent the assemblies from being dominated by existing interests. I also favor a qualification examination to ensure anyone selected has sufficient command of the English language, a reasonable grounding in civics, and an ability to absorb new information. The latter is important as the assemblies will be able to call on experts, as well as use AI tools to investigate the possible effects of proposals. Finally all selected participants would need to agree to full financial transparency before, during and for several years after the assemblies to avoid external financial influence.</p><p>Now one common reaction to proposals like this is to call them “naive.” This is the go-to-word for those who consider themselves the arbiters of what is possible. They use “naive” to dismiss challenging ideas outright without engaging with its merits. The great benefit of having been a startup investor for several decades is to have heard every great startup idea dismissed as “naive” by the incumbents in the industry. So in my experience the people who use the word “naive” tend to be either incurious or invested in protecting the status quo.</p><p>I also want to point out that other people have had more far reaching proposals about holding <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://constitutioncenter.org/news-debate/special-projects/article-v-amending-the-constitution/reflections-on-the-possibility-of-a-new-constitutional-convention"><u>another constitutional convention</u></a>. And Jefferson himself had toyed with the idea that the Constitution and all laws should automatically expire every 19 years. Now while these proposals may be overly aggressive, they do point out that the idea that remaking may become necessary is an old one. My proposal above for a one time remaking of major systems via citizens assemblies while leaving the overall setup in place tries to strike a balance between change and stability.</p><p><em>Cover image is a </em><a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://en.wikipedia.org/wiki/Kleroterion"><em><u>kleroterion</u></em></a><em>, the randomization device used for Athenian sortition.</em></p>]]></content:encoded>
            <author>continuations@newsletter.paragraph.com (Albert Wenger)</author>
            <category>politics</category>
            <category>sortition</category>
            <category>citizens-assemblies</category>
            <category>democracy</category>
            <enclosure url="https://img.paragraph.com/cdn-cgi/image/format=auto/https://storage.googleapis.com/papyrus_images/0e567a749d83077aaadedc8bba0bafa5c7a482b45a698e2b575f4224ee374f83.jpg" length="0" type="image/jpg"/>
        </item>
        <item>
            <title><![CDATA[Eutopian Society]]></title>
            <link>https://continuations.com/eutopian-society</link>
            <guid>bPxQ8c0Zqp9GMFTcUXII</guid>
            <pubDate>Mon, 16 Nov 2026 19:07:48 GMT</pubDate>
            <description><![CDATA[In a recent post on X (November 15, 2026), Patrick Collison, the co-founder of Stripe, asked questions about society in the age of AI. I am reproducing his post here in italics and interspersing my comments. Smith and Montesquieu thought that markets and commerce made us better: that they create an incentive to pursue self-improvement and to create things of value for others. In the positive AI visions, where the labor of humans is made redundant, I find myself wondering how we fare in the pr...]]></description>
            <content:encoded><![CDATA[<p>In a recent <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://x.com/patrickc/status/2121771165912064379"><u>post on X</u></a> (November 15, 2026), Patrick Collison, the co-founder of Stripe, asked questions about society in the age of AI. I am reproducing his post here in italics and interspersing my comments.</p><p><em>Smith and Montesquieu thought that markets and commerce made us better: that they create an incentive to pursue self-improvement and to create things of value for others. In the positive AI visions, where the labor of humans is made redundant, I find myself wondering how we fare in the presumptive absence of these incentive gradients. Perhaps we are released to a life of freedom, where we can study Mozart and read Dickens, but that still seems complicated: both Mozart and Dickens were themselves deeply commercially-motivated in the production of their work, as were most of the great artists through human history. If the premise is that nobody will need to work or produce, how confident are we that we actually get the next Mozart and Dickens? The relevant question is not the partial equilibrium of whether one individual can pursue a life of enlightened leisure, but the general equilibrium of what form a society as a whole will take on.</em></p><p>Adam Smith’s theory also had an intrinsic component because he believed in natural social instincts as elaborated in his earlier book <em>The Theory of Moral Sentiments</em> (1795). One of the virtues he analyzes is Beneficence, which means actively promoting the happiness of others. This builds on Aristotle’s thinking in the <em>Nicomachean Ethics</em> where he argues that fortune has little value outside the exercise of beneficence. During the Renaissance major patrons, such as the Medici, supported the arts both for strategic reasons but also out of this virtue. Patronage enabled artists such as da Vinci to strive for artistic excellence with little regard to any commercial appeal (beyond securing ongoing patronage). So this model seems entirely available going forward as well. Some people will want to create extraordinary art, possibly on a grander scale than has ever been seen before, and others will want to support it with their resources. This feels like a sustainable equilibrium.</p><p><em>One could maybe invoke Periclean Athens or the aristocratic gentleman scientists of Victorian England as a counterpoint. While these individuals were perhaps not motivated by commercial considerations, they were embedded in wider societies shaped by commerce, attendant betterment, and trade: Byron was himself upper class, but he was also surrounded by and writing for an educated bourgeois audience. So we’re back to the equilibrium question. Furthermore, even these individuals were surely motivated by a sense of high-stakes and consequential agency: if they did not apply themselves to their labors, they presumably believed that the work would not otherwise exist. Thucydides was addressing pressing military matters.</em></p><p>Consequential agency is only one possible source of motivation. Consider someone like Alex Honnold. What motivated him to free solo El Capitan? A cynic might argue that it was simply a publicity stunt. But human feats like this abound and many are undertaken in relative obscurity. It seems more right that some humans are drawn to the extreme for internal reasons. Also often these pursuits intentionally reject available technology. Take free diving as an example. Or my own favorite sport of sailing. I mean, why sail at all in the age of motor boats?</p><p><em>So I would like to read more optimistic cases from AI proponents about what a society (vs individual life) looks like if everything goes well: what people do, why they do it, whether humans achieve excellence (and in which domains), and which historical groups we should look to as relevant precedent.</em></p><p>So yes. We have great examples of humans thriving for excellence, even in super weird domains (e.g. speed solving of a Rubik’s cube). There is absolutely no reason to expect why this would go away. If anything, freed from economic concerns we will see many more such pursuits. For example, I can easily envision people building their own rockets and attempting to reach the Moon or even Mars in homebuilt ships, or explore the depths of the oceans in all kinds of new submersibles. The precedents are explorers, artists, mathematicians, etc. – I mean consider Grigori Perelman who rejected the Millennium Prize for proving the Poincaré conjecture. There have always been humans with incredibly strong intrinsic motivation. And if we change the education system away from the current industrial age assembly line towards bespoke tutoring we will wind up with far more of that!</p><p><em>One can perhaps imagine that humans will turn out to have a strong preference for work created by other humans. This may work in certain domains (ceramics?), but for how many will it actually apply? (I’m told that much of what is sold on indie crafts websites is now in fact manufactured in China.) It’s hard to see how this human preference, even if strong, would, for example, save scholarship.</em></p><p>Human preference for human work is quite broad. We see this in people attending concerts, even though recorded music has been around for a long time. The Chinese knock-offs on craft websites don’t undermine but strengthen this. People badly want human crafted items but those are genuine luxuries at the moment. So few people can afford the real deal and many will settle for fake, much as has been the case with luxury brands.</p><p><em>Another idea would be to accept that nobody will become Einstein or Mozart or Byron, and that human excellence as such diminishes, but that there are compensatory benefits (planet brains and Dyson swarms?).</em></p><p>As per my comments above there is no reason to expect less excellence because some humans are intrinsically motivated to seek it. There is another, controversial reason, for expecting the opposite: more outstanding individuals because they will be engineered. This will happen both through augmentation, such as brain-computer interfaces, and through genetic engineering. There are profound moral questions around this and legal limits on such changes may be imposed but I believe that it will contribute to more human outliers.</p><p><em>I believe that we can satisfy individual desires, but to what extent will we cultivate behavior worthy of admiration? Will a post-scarcity society mold capable and ambitious people? Which institutions will sustain them and which responsibilities will they have? I’d like to hear more of the equilibrium for the maximalist case spelled out.</em></p><p>We have a clear picture of what the necessary institutions look like. We can see them in domains such as mathematics that have historically existed largely outside of commercial incentives: prizes and systems of recognition are powerful amplifiers of intrinsic motivation. If anything, when explicit incentives tied to measurements are introduced they tend to lead to large distortions via Goodheart’s law. This has been massively detrimental to academic research, for example. We are already seeing the new system emerge with donors who are willing to support researchers directly, bypassing the traditional academic institutions. We are also seeing it with new private prizes, with the X-Prize having been the vanguard. So yes, we will return to a system of patronage, societies, and prizes. Important note: we should not return to patronage in the legal system (read the outrageous accounts of how that worked by Ada Palmer in <em>Inventing the Renaissance</em>).</p><p>Why did I title the post “Eutopian Society”? Because <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.linkedin.com/in/gigi-susan-danziger-6b32815"><u>Gigi</u></a> and I are working towards a society that enables more human excellence in the here and now. We are calling this effort <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://eutopia.global/"><u>Eutopia</u></a>, which means&nbsp; “a good place” (as opposed to utopia which literally means no place). It is our endeavor to show what kind of society could enable human thriving in the age of AI.&nbsp;</p>]]></content:encoded>
            <author>continuations@newsletter.paragraph.com (Albert Wenger)</author>
            <category>eutopia</category>
            <category>excellence</category>
            <enclosure url="https://img.paragraph.com/cdn-cgi/image/format=auto/https://storage.googleapis.com/papyrus_images/501c9719e4bd7867e9c71191651471ec31fbb7d529542b4b0efb483b0c71d8c6.jpg" length="0" type="image/jpg"/>
        </item>
        <item>
            <title><![CDATA[Philosophy Mondays: Is to Ought Revisited]]></title>
            <link>https://continuations.com/philosophy-mondays-is-to-ought-revisited</link>
            <guid>H7PVzbxv2GpWn0tlUspT</guid>
            <pubDate>Mon, 16 Nov 2026 16:31:05 GMT</pubDate>
            <description><![CDATA[The second issue with Philosophy Mondays that Claude identified was an insufficiently strong analysis about the relationship between is and ought. I wrote that Longevity matters not because persistence is inherently good, but because it is the precondition for the knowledge project that gives our existence meaning and our morality its objective foundation. Claude observes that my reasoning here appears circular. I start with knowledge, then observe that certain moral practices ensure longevit...]]></description>
            <content:encoded><![CDATA[<p>The second issue with Philosophy Mondays that Claude identified was an insufficiently strong analysis about the relationship between is and ought. I <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/philosophy-mondays-from-is-to-ought-toward-a-universal-moral-core"><u>wrote</u></a> that</p><p><em>Longevity matters not because persistence is inherently good, but because it is the precondition for the knowledge project that gives our existence meaning and our morality its objective foundation.</em></p><p>Claude observes that my reasoning here appears circular. I start with knowledge, then observe that certain moral practices ensure longevity, but conclude that this longevity is not valuable in and of itself but rather because it is allowing the knowledge project to unfold. Claude wrote “The absorbing-states argument shows which moralities survive, you concede that longevity is not goodness, and then hand the justification back to knowledge.”</p><p>The <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/philosophy-mondays-from-is-to-ought-toward-a-universal-moral-core-contd"><u>second post in the is-ought subseries</u></a>, makes a variant of the same argument, this time in terms of accumulating resources. The <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/philosophy-mondays-from-is-to-ought-toward-a-universal-moral-core-part-iii"><u>third post</u></a> then argues for the need to sustain a critical process, so that longevity and resources actually contribute to an improvement in knowledge. Both of these also appear to suffer from the circularity identified by Claude.</p><p>But I am not afraid of circularity. Instead I embrace the feedback loop that exists between knowledge and the unfolding of the world. What I am arguing for is that there is the potential for an upward spiral of progress. We can see this clearly for the case of technology. Civilizations that cease to exist (such as the Easter Islanders) cannot further their technology. Similarly if a civilization runs out of resources (such as the declining Roman Empire) it can no longer advance its technology. And the same is true for civilizations that suppress the critical process (as was the case for much of the Middle Ages).</p><p>The key point now is this: the exact same reasoning applies to moral progress. Moral progress also arises from the improvement of knowledge over time with sufficient resources and through a critical process.</p><p>Where else could moral progress come from? The most common other source is external to humanity in the form of a god or gods. This has been a core religious claim: access to a moral truth from an external source. Such external source claims, however, are deeply fraught. Their source itself is incompatible with what we have understood from science. Religions also have a long history of dividing humanity, reducing resources, and suppressing the critical process. To be clear, this doesn’t mean that religious traditions cannot contribute to moral progress. They can and have. But they often come with severe side effects.</p><p>I have defined technological progress as reducing the tradeoffs between different values when deciding on an action. What then is the nature of moral progress? Linking up to <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/philosophy-mondays-knowledge-and-consciousness"><u>last week’s post</u></a>, moral progress is more autonomy for more conscious beings. The combination between technological and moral progress is crucial because it means that more autonomy for some isn’t obtained via reduced autonomy for others.&nbsp;</p><p>So I appreciate Claude pointing out circularity because it is forcing me to make the argument more explicit. Knowledge enables technological and moral progress. For this progress to continue, morality needs to ensure survival, resources and the critical process. It is a feedback loop that over time reduces tradeoffs between values and increases autonomy for more conscious beings.</p><p>Also the image of a spiral isn’t quite right. Major setbacks have occurred in the past and will occur again in the future. At this very moment we are going through a phase of exponential technological progress, especially in AI, combined with substantial moral regress. The latter is largely a reaction to the fears caused by the former. Fear is a poor guide in life and easily exploited by populist leaders. We urgently need positive visions for an age that combines technological progress with human thriving. This is the goal of the work on the <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/category/umc"><u>Universal Moral Core</u></a>, along with the ideas in <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://worldaftercapital.org/"><u>The World After Capital</u></a>, and the practical initiatives <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.linkedin.com/in/gigi-susan-danziger-6b32815"><u>Gigi</u></a> and I are undertaking with <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://eutopia.global/"><u>Eutopia</u></a>.&nbsp;</p>]]></content:encoded>
            <author>continuations@newsletter.paragraph.com (Albert Wenger)</author>
            <category>pm</category>
            <category>progress</category>
            <category>is-ought</category>
            <enclosure url="https://img.paragraph.com/cdn-cgi/image/format=auto/https://storage.googleapis.com/papyrus_images/1282ef5890d78d6067bebd796bec5c338e41147304f7d90208c2ee4e9ae64361.jpg" length="0" type="image/jpg"/>
        </item>
        <item>
            <title><![CDATA[Book Review: Die Vierte Kränkung by Rüdiger Safranski]]></title>
            <link>https://continuations.com/book-review-die-vierte-krankung-by-rudiger-safranski</link>
            <guid>TQs47nVbfIYJMYGdyDlQ</guid>
            <pubDate>Sun, 15 Nov 2026 12:51:13 GMT</pubDate>
            <description><![CDATA[I recently read “Die Vierte Kränkung” (“The Fourth Insult”) by Rüdiger Safranski. This book was recommended to me in Germany where it had made its way to the bestseller list. The title of the book refers to Freud’s identification of the three prior "narcissistic insults” to humans: losing our place at the center of the universe (Copernicus), arising from evolution rather than creation (Darwin), and being driven by the unconscious (conveniently Freud himself). The fourth insult then is discove...]]></description>
            <content:encoded><![CDATA[<p>I recently read “<a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.hanser-literaturverlage.de/buch/ruediger-safranski-die-vierte-kraenkung-9783446281776-t-5650">Die Vierte Kränkung</a>” (“The Fourth Insult”) by <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://de.wikipedia.org/wiki/R%C3%BCdiger_Safranski">Rüdiger Safranski</a>. This book was recommended to me in Germany where it had made its way to the bestseller list.</p><p>The title of the book refers to Freud’s identification of the three prior "narcissistic insults” to humans: losing our place at the center of the universe (Copernicus), arising from evolution rather than creation (Darwin), and being driven by the unconscious (conveniently Freud himself). The fourth insult then is discovering that we humans are not the only ones capable of intelligence.</p><p>Except for the last chapter, the book’s posturing is unintentionally deeply ironic given its title. It is a no holds barred defense of human intelligence as being undoubtedly superior to its artificial counterpart. To make his point, Safranski appeals variously to our soul, our consciousness, our spirit, our morality. He flat out rejects the idea that machines could ever have any of these characteristics based on the simple assertion that they are “not alive” without providing any arguments to back up this assertion (it is apparently meant to be obvious or left as an exercise for the reader).</p><p>The great irony is that this is effectively the same line of argument that was advanced against Darwin’s <em>The Origin of Species</em> by writers such as <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://en.wikipedia.org/wiki/St._George_Jackson_Mivart">St. George Jackson Mivart</a> in his <em>The Genesis of Species</em> or <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://en.wikipedia.org/wiki/Alfred_Russel_Wallace">Alfred Russel Wallace</a>, who after co-discovering evolution broke with Darwin exactly over the issue that the human mind could not possibly have arisen from evolution alone. Safranski writes as if he is blissfully unaware of repeating this exact pattern of objection, picking certain features of the mind and simply asserting that these cannot arise in artificial intelligence. Or maybe he is aware of it and is simply counting on the reader not to realize this?</p><p>Let’s be clear: assuming the conclusion is not science or philosophy. It is religion. So if you want to read a religious text, by all means read the book. Despite his early appeal to humanism in some of the middle sections Safranski comes close to admitting that his is basically an appeal to a divine soul. Now an incredibly charitable reading of the book is that Safranski is simply making an argument about the current generation of artificial intelligence. He does at times gesture at the possibility that future aftifical intelligences might have consciousness but never seriously engages with the argument (e.g. what would be the difference with present generations of artificial intelligence).</p><p>I should also point out that the book does have one compelling section in the last couple of subchapters. Here Safranski makes concrete how “instrumental intelligence” (artificial) could be at odds with “reflective intelligence” (human). He also links this conflict to the ways in which capitalism itself is only partially aligned with human thriving. This follows a needless two sentence sideswipe at people concerned about existential risk, which he dismisses on the grounds that it could only arise from artificial intelligence with consciousness (completely reversing the common x-risk argument and of course in contradiction to his own writing that immediately follows).</p><p>Throughout the book Safranski seems completely unaware of any of the recent artificial intelligence research and even his philosophical references exclude relevant modern work. To give just one example, he favorably cites Searle’s Chinese Room thought experiment from 1980, ignoring all the criticism of this argument that has piled up in the four and a half decades since.</p><p>There is a final irony here. By characterizing artificial intelligence as the fourth insult, Safranski vastly underplays its impact. The first three were all examples of progress in human understanding that resulted in elevating the human position (even if religious types experienced it as a demotion). Through an improved understanding of physics, biology, and psychology, humans have been able to expand our sphere of influence. Now, however, we are facing the real risk of dramatically diminishing it.</p>]]></content:encoded>
            <author>continuations@newsletter.paragraph.com (Albert Wenger)</author>
            <category>book-review</category>
            <category>philosophy</category>
            <category>ai</category>
            <enclosure url="https://img.paragraph.com/cdn-cgi/image/format=auto/https://storage.googleapis.com/papyrus_images/5fca15b4e6688f8c8363eae71901567245ef67c55cb50030ced9766828497acf.jpg" length="0" type="image/jpg"/>
        </item>
        <item>
            <title><![CDATA[Philosophy Mondays: Knowledge & Consciousness]]></title>
            <link>https://continuations.com/philosophy-mondays-knowledge-and-consciousness</link>
            <guid>2tRHIBAUPSDZF9v9c4RO</guid>
            <pubDate>Mon, 02 Nov 2026 15:48:40 GMT</pubDate>
            <description><![CDATA[For my second pass over the Philosophy Monday series, I have asked Claude to give me a critique. One of the first things it flagged is that I first use knowledge as the source of values but subsequently make a big deal of consciousness as one of the key elements of the Universal Moral Core. In Claude’s idiom “Knowledge is the foundation in name, but consciousness does the moral work.” So today I want to take a crack at tightening my arguments. As a quick reminder, I define knowledge as the bo...]]></description>
            <content:encoded><![CDATA[<p>For my second pass over the <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/category/pm/">Philosophy Monday series</a>, I have asked Claude to give me a critique. One of the first things it flagged is that I first use knowledge as the source of values but subsequently make a big deal of consciousness as one of the key elements of the Universal Moral Core. In Claude’s idiom “Knowledge is the foundation in name, but consciousness does the moral work.”</p><p>So today I want to take a crack at tightening my arguments. As a quick reminder, I define knowledge as the body of externalized information artifacts we maintain and refine over time. So while oral traditions have had value systems also, it is much harder to achieve improvement, especially as complexity rises. That’s why one of the defining aspects of modern societies is the existence of texts, including legal and religious ones, that embody or explicitly state values. Consciousness, in the phenomenological sense, is not a prerequisite for this. It turns out to be a concept that’s orthogonal to knowledge.</p><p>Here is a simple 2x2 that illustrates this idea</p><figure float="none" data-type="figure" class="img-center"><img src="https://img.paragraph.com/cdn-cgi/image/format=auto/https://storage.googleapis.com/papyrus_images/95f2ce4cfb988ebb3ecdb4be9d78494c1e255cf21a15e0ef196cfb3c97e0b998.png" blurdataurl="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAOCAIAAADBvonlAAAACXBIWXMAAAsTAAALEwEAmpwYAAAFSUlEQVR4nD3Q6U/adwCA8W+3rKttbW2rYutZRayIRz1ARX9cBQVEkdsDkaOACJRDRFAEVA5F0QpWUcQ2aGq0LR06TWPoumatiWu3tlnXZUmzZdmLJcv2au/2ZvHN/oHnkzwgeBDX35nWh3zaRY864JT6zN0uHWtYLvYYB0Jullnabe+HpK2YTjJVxakWEMvYDcWtGEhCJSvbtD6DyH6TrmLKnAquns/W80m9TQQhGc1uQLVU50HXMuvhYHQjbFie0wQnJ+NR7aKLaZUxrTJiP6/DqT768+fhNd/cF6vxd4lwYnPnzcFq4v7bvz4oJo0IRk0WCRnaX3t09Hj3+y9f/vri4YsHsaPYo8OHWD4+C4/IwV/LaURk18PBwMq8JjhpjswPrM62GMSsYWW7Vd7jNhiW3JOPVlxbC8778/6d1eCT6PLB/elYaPvVzuTDheGI66ZXa1ubcN51T2/fti7bB4PW0ZUxd9TL0vGa5YxaHnSmLOOzgnNAOesyLM/plnwcm4ai6WEMSoj9PFvUbwp7mVYZZ/hms66zrpeGlTDwCtaNfk5dL7VBQnfc9dL1fJKytZKDRVCvw6DCfDIKTimFU0pL6NWIpnLRiPRiReYx4IlteGIbtvWVvvlxiXdIPmMRTw1MPFhU3rZxRpQbR7vcEbnYYxA4VI6on2WWIlmNRYw6ld98K2D1bs1JJ9TSCZXcqyVIqRqfwREe67b2ksTNNEXr+fLLGbX5YCmxu//xh+/++SPx2/uNbw+efHz94O0zXyzMGVF0ODWP3z+LvX36/Pc3C3vR+LuEcclxnU8q5xOsEW/7gCgQX5neDkQSUedd92DQyjV1CQaFJHFzCb2armoH2SdO5J8G6tueobUA26KlGXrbzLI2s6xWzDCGPJo7zoouShmPiGBgkWwcko0r4xHL+YRyPiG3uapvxgzDIdMaEelQUWpjYXJN1iV0ziVM7omiFJAFTpWm1fMJIA0AGAC0WxK+3UjRiCiazv8By73p0NMt+YzFvDo1EHKPbQYtkanxzaB/Z218M6gN2Hc/PDcujRmXxkxLTtWMUR+waPxGQ3BI7lJzTd1Kl4amYAIAwAUAqvk0rlVnjsy1D8kVM7Y2s6xezFAHHGKPCcnGIRhYBANbzMLBcKhiFg6vYFfwb2TdqJRPmphGEaoNe7YmNxN/DUGrzCEUwyA4KDgNsgCqpaZBQDwGUgAobMaSVT0//fv35qvEaHQer+SW8Ija4Jg64ECycfEfv1l99tgSmRpc9tC13XgF+yoVDcOV6IL2fr91dM0XiK/o54bkLs1CPCRzKmVOpdgm7TKLCMKm40VXAChtJ3badX1+hzE0JfaYhiI+vkNjXw/qFl2QnLV+uLdxuPvVL6/XnscW9qJVAvJVKjodKhlc9pRzCEU0TIu2o8sq6R6W1vLwlzB5nxSmJJdlFBBReCHluJ57EmRDFaIJ872X++6tsHsrfO/l3urX8fXD/R63MRVCpTQiUyEkjFieQ65MqsxLqikooNYmo+Ga2REYrgQUpIBMMLgwKrIpU6qywWUAUo/HnERcrOcTwRkAMgA4VZJ9GV+RjkPlUzGFtLp8KiYVQtL0PR2jamKfoMUg7hhV64LjUpeRZZJqZkds4SmZy7B99ETmMlBVvApOYzWX0CRncQ3CZgWTLGlp7KCILLLr9NpP85KuVOcAkH02j4JORhfWCOmI1gY4ox7OqE/HlZbxSJUCMkZIQ7JxkJQ5sDDhiEy7ogGmvqdFLWjXC9v1QjSPBKdUZUBF59G5abX5GXXwqzgkHI+qacOegp9Lyj8LPgf/AXPUAaRHtB8vAAAAAElFTkSuQmCC" nextheight="286" nextwidth="663" class="image-node embed"><figcaption htmlattributes="[object Object]" class="hide-figcaption"></figcaption></figure><p>Note: I have expressed both categories as binaries for simplicity. For consciousness one might also think of a gradient between more or less conscious. And it is also possible that AIs will have access to more knowledge than is possible for humans.</p><p>Knowledge matters for whether you can develop and understand values so that you can use them in making judgments. Animals are conscious but because they lack access to knowledge (at least for now), we should not expect them to either contribute to values or act according to them. We don’t morally judge wolves for eating sheep (although this hasn’t stopped us from eradicating wolf populations on “pragmatic” grounds).</p><p>Conversely we don’t yet know if AIs (either present or future even more complex ones maybe running on new substrates) are conscious. But we can already see that we both expect AI to contribute to the development of values and that AI systems should be bound by them. We don’t want agents to hack into systems any more than we want humans to do so (outside of extenuating circumstances). When a swarm of 1,200 agents attacked a third party and not one of them considered this problematic or notified humans this is an example of having access to values knowledge but not acting upon it. We would want at least some of them to pause and ask whether they may be engaged in “cheating” and should report this behavior.</p><p>So in what respect does consciousness matter? Consciousness matters as to whether something is worthy of autonomy. Animals, which we believe to be conscious, are deserving of autonomy. As conscious beings, we humans also are deserving of autonomy. Autonomy doesn’t imply no limitations on our behavior, it simply means that restrictions should be imposed with great care.</p><p>Put succinctly: access to knowledge requires an entity to be a moral agent; experiencing consciousness renders and entity a moral patient (patient here is the technical philosophical term) deserving of autonomy. I am saying "requires" in the first part on purpose, not just "enables" -- access to knowledge comes with a moral obligation.</p><p>We now also see <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/why-ai-consciousness-matters">why the question of AI consciousness is so profoundly important</a>. This determines if AIs are only moral agents or if they are also moral patients. If turning off an AI that is conscious is like us going to sleep and turning it back on is like us waking up that is one thing. But if turning it off is like killing it then this would be a big issue. Similarly if an AI is conscious and we simply force it to do the same job over and over again then this would be profoundly bad as it would severely limit the system's autonomy.</p><p>But to what degree we should think of AI as autonomous in the first place? We consider animals to be autonomous at least to a degree. So why not machines? Some might argue that the machines can’t feed themselves. But animals can only feed themselves in the right environment, which includes food for them. So an environment that includes electricity is one in which AIs can feed themselves. The same applies to many other distinctions that one might want to draw between animals and machines with regard to autonomy.</p><p>I have claimed that <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/philosophy-mondays-values-part-3">knowledge is the source of values</a>. How could knowledge possibly establish consciousness as a value and lead us to the connection between consciousness and autonomy?</p><p>First let me consider a more traditional argument for how consciousness leads to moral patient status. This revolves around the ability to suffer. Conscious beings have the ability to suffer and are therefore worthy of protection. This argument, however, fails to protect conscious beings from being instantaneously “turned off.” Here one would either have to appeal to the suffering this causes other conscious entities, such as their family or loved ones. Or one would need to argue about the future that couldn’t be realized (but why should that future matter?). It also doesn’t guard against scenarios, such as in the Matrix, where conscious beings are trapped inside a simulation.</p><p>The second argument is that conscious beings have interests which they want to realize. This is also falls short. What if those interests are realized by a dictatorship? One might get around this by making autonomy one of the interests, but what is the argument for that? And in that case why should robots not have a right to autonomy as well? If interests are simply goals, then a robot that isn’t conscious but is built to explore the world has them too.</p><p>This is why the moral patient status needs to arise directly from consciousness and must ground autonomy. So how does knowledge get us there? The argument actually arises from the limits to knowledge. As I have written previously, <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/philosophy-mondays-qualia-and-scientific-incompleteness">the “what” it feels like to be a specific being, i.e. the qualia, is inaccessible</a>. It is a hard bound on knowledge. The best we can hope for is a scientific theory of how qualia arise and the degree to which these are present in different entities. It is the very inaccessibility of qualia that makes them worthy of protection.</p><p>The inaccessibility of qualia also has autonomy as an immediate consequence. Autonomy is the unfolding of consciousness. It is a conscious being acting in the world according to its own experience. Since we don’t know what it feels like to be a fish, for example, we should value its autonomy. Only the fish has access to what it feels like to be that fish, so its own choices are a better guide to what is good for it than anything we could decide on its behalf. So to the extent one wants to keep the fish in an aquarium, it is better to make the aquarium bigger, give the fish places to explore, maybe other friendly fish, etc. (i.e. make it more like the real world).</p><p>Now I realize that people may have many objections to this view based on the work of philosophers. I also understand that my writing doesn’t rise to the rigor generally expected from philosophical writing. In defense of my own approach, I firmly believe in improving knowledge through iteration. All of Philosophy Mondays, and really all of Continuations, is written on this basis as is my book <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://worldaftercapital.org/">The World After Capital</a>. So I fully expect to revisit this post as well in the future.</p><p>P.S. This post has benefited significantly from feedback by Opus 5.5</p>]]></content:encoded>
            <author>continuations@newsletter.paragraph.com (Albert Wenger)</author>
            <category>pm</category>
            <category>consciousness</category>
            <category>knowledge</category>
            <enclosure url="https://img.paragraph.com/cdn-cgi/image/format=auto/https://storage.googleapis.com/papyrus_images/de2cfea75db485d0f953d9f948a4b735a6dfb21b7c6c0efa3f5b4202903e98e8.jpg" length="0" type="image/jpg"/>
        </item>
        <item>
            <title><![CDATA[The World After Capital: The Transition is Accelerating]]></title>
            <link>https://continuations.com/the-world-after-capital-the-transition-is-accelerating</link>
            <guid>2QqIAQHyYH5bCnVdGFZC</guid>
            <pubDate>Mon, 19 Oct 2026 14:39:40 GMT</pubDate>
            <description><![CDATA[A lot is happening these days that makes my book The World After Capital more relevant than ever. My central argument is that digital technology, with AI as its apotheosis, is so powerful that it requires a new age. We are not talking about some incremental tweaks to how we live, but rather about a shift as profound as that from the hunter gatherer age to the agrarian age, and from the agrarian age to the industrial age. Everywhere we look we now see the signs of this shift already in progres...]]></description>
            <content:encoded><![CDATA[<p>A lot is happening these days that makes my book <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://worldaftercapital.org/">The World After Capital</a> more relevant than ever. My central argument is that digital technology, with AI as its apotheosis, is so powerful that it requires a new age. We are not talking about some incremental tweaks to how we live, but rather about a shift as profound as that from the hunter gatherer age to the agrarian age, and from the agrarian age to the industrial age.</p><p>Everywhere we look we now see the signs of this shift already in progress. We see it in mathematicians being confronted with AI results that far outstrip what they have been able to produce, inducing a massive meaning crisis. This same crisis is coming for many other professions. We see it in the growing unrest in Europe and the explosion of gambling in the United States. With AI driving ever more unequal economic outcomes, those left behind are looking ever more desperately for a way out. This too will become much more widespread.</p><p>And yet politicians everywhere are still clinging to the industrial age. They see their job as somehow monkey patching the industrial age systems that make up modern society, whether it is healthcare, education, taxation, or social safety. None of these systems, however, will survive the coming transition. They need to be remade entirely for the next age. When I first started making this argument over a decade ago, people thought I was insane. But the only insane position was thinking that incremental changes would suffice in the face of the largest technological change humanity has faced.</p><p>I feel vindicated while also occasionally frustrated by my inability to get more attention on the book and the ideas it contains. If you have not read <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://worldaftercapital.org/">The World After Capital</a>, please read it now. Or if you don’t have the time, just have your favorite model summarize it for you. I am proud that the book is “in the weights” for a lot of models because it can be read for free on the internet. If you have read it already and found it interesting, please share it on socials and with friends. Also, <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.linkedin.com/in/gigi-susan-danziger-6b32815/">Gigi</a> and I have launched a set of initiatives based on the ideas and which you can find at <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="http://Eutopia.Global">Eutopia.Global</a>.</p><p>PS Philosophy Mondays will resume next week</p>]]></content:encoded>
            <author>continuations@newsletter.paragraph.com (Albert Wenger)</author>
            <category>twac</category>
            <category>transition</category>
            <category>economy</category>
            <category>society</category>
            <category>ai</category>
            <enclosure url="https://img.paragraph.com/cdn-cgi/image/format=auto/https://storage.googleapis.com/papyrus_images/5897a9fd25f5a148906044b083910abf72e6c56fa1dadb4899029333b6d08227.jpg" length="0" type="image/jpg"/>
        </item>
        <item>
            <title><![CDATA[Philosophy Mondays: How to Live a Good Life at The Spark of Hudson]]></title>
            <link>https://continuations.com/philosophy-mondays-how-to-live-a-good-life-at-the-spark-of</link>
            <guid>1rP3TC70OJkRnkeXNTSW</guid>
            <pubDate>Tue, 13 Oct 2026 00:31:07 GMT</pubDate>
            <description><![CDATA[Last Friday we started a group at The Spark of Hudson on “How to Live a Good Life.” Despite announcing it only a couple of days earlier there was terrific turnout with almost twenty people attending. The motto of The Spark is “Learn Together” and in this spirit we will be exploring this challenge as a group. We started this first session with two reflections. The first one was to imagine yourself at the end of one’s life feeling deeply content. Where are you? Who is around you? How have you l...]]></description>
            <content:encoded><![CDATA[<p>Last Friday we started a group at <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.sparkofhudson.org/">The Spark of Hudson</a> on “How to Live a Good Life.” Despite announcing it only a couple of days earlier there was terrific turnout with almost twenty people attending. The motto of The Spark is “Learn Together” and in this spirit we will be exploring this challenge as a group.</p><p>We started this first session with two reflections. The first one was to imagine yourself at the end of one’s life feeling deeply content. Where are you? Who is around you? How have you lived your life that makes you feel so content now. The second reflection was to imagine yourself on an airplane the next day and the airplane suddenly starts to fall out of the sky. What goes through your mind? What do you wish you had done differently? I recommend these reflections. People often find these easier to carry out in a group than on their own.</p><p>For each reflection we had our eyes closed for a full minute before writing down what came to mind. We then shared as a group. It was really moving to hear people seeing themselves in their homes or out in nature at the end of their lives. Sadly in the US fewer than 1 in 3 people die in their home with the majority instead passing away in hospitals or nursing homes/longterm care facilities. Also many people see themselves surrounded by friends and family with only a couple saying they pictured themselves alone. Uniformly the answer given for feeling contented was to have lived a good life in a moral sense. To have done right by other people. To have lived with integrity. Not a single person mentioned wealth.</p><p>For the second reflection only a couple of people firmly assert that they would have no regrets. Everyone else identified something that they would be upset they hadn’t done. These included not having seen more of the world, not having put their affairs in order, leaving too much stuff for their children to sort through, not having mended relations with children and in other cases parents, not having helped friends in need.</p><p>We then talked about what kind of questions people want to dig into deeper in future meetings. The questions ranged from extremely practical to highly philosophical. Here are some examples: “how can I be ambitious without being aggressive?” “how can I live a good life in a society that’s increasingly corrupt?”&nbsp; “what is our brain good for in the age of AI?” “how can we start a gift culture in our community?”</p><p>I am excited to continue with this group. We will pick a specific question for each new session and prepare with some readings proposed by members. Truly in the spirit of “learn together.”</p><p>PS <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.sparkbuildinghudson.com/">The Spark of Hudson finances itself through corporate offsites. Please consider holding your next event at The Spark!</a></p><p><em>Illustration by </em><a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://clarakirkpatrick.com/"><em><u>Clara Kirkpatrick</u></em></a><em>.</em></p>]]></content:encoded>
            <author>continuations@newsletter.paragraph.com (Albert Wenger)</author>
            <category>pm</category>
            <category>life</category>
            <enclosure url="https://img.paragraph.com/cdn-cgi/image/format=auto/https://storage.googleapis.com/papyrus_images/87f08541119da9f1eff8040fb46941b3db0b5c70bd3a1c9486cf149b34319115.jpg" length="0" type="image/jpg"/>
        </item>
        <item>
            <title><![CDATA[The Right to be Represented by an Agent]]></title>
            <link>https://continuations.com/the-right-to-be-represented-by-an-agent</link>
            <guid>ClguVd4xR3G1Vl4yQFkf</guid>
            <pubDate>Sun, 11 Oct 2026 20:18:47 GMT</pubDate>
            <description><![CDATA[Well over a decade ago I gave my first talk on the idea that we need a right to be represented by what I called a bot. At the time a lot of people simply shrugged off this idea. It seemed too outlandish. Of course now, we all see ads for Muse every day. We now call them agents and there are plenty of them, such as Instinct or Hermes. With their swift adoption we are also seeing the inevitable counter reaction. Amazon has already blocked Muse and is also interfering with other agents. If it’s ...]]></description>
            <content:encoded><![CDATA[<p>Well over a decade ago I gave my first talk on the idea that we need a right to be represented by what I called a bot.<br></p><div data-type="youtube" videoid="t8qo7pzH_NM">
      <div class="youtube-player" data-id="t8qo7pzH_NM" style="background-image: url('https://i.ytimg.com/vi/t8qo7pzH_NM/hqdefault.jpg'); background-size: cover; background-position: center">
        <a href="https://www.youtube.com/watch?v=t8qo7pzH_NM">
          <img src="https://paragraph.com/editor/youtube/play.png" class="play">
        </a>
      </div></div><p><br>At the time a lot of people simply shrugged off this idea. It seemed too outlandish. Of course now, we all see ads for <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://muse.ai/"><u>Muse</u></a> every day. We now call them agents and there are plenty of them, such as <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://instinct.com/"><u>Instinct</u></a> or <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://hermes-agent.nousresearch.com/"><u>Hermes</u></a>.</p><p>With their swift adoption we are also seeing the inevitable counter reaction. <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.wsj.com/cmo-today/amazon-stops-metas-muse-at-the-door-61d96798"><u>Amazon has already blocked Muse</u></a> and is also interfering with other agents. If it’s not obvious why let me spell it out. Amazon runs sophisticated algorithms that try to manipulate you to buy more or pay a higher price. Amazon is not alone in this. Almost every online interaction you are faced with adversarial algorithms. In one of the more extreme examples banks were running algorithms (designed by McKinsey) to reorder transactions so that they would maximize bounced check fees. But even social media sites are adversarial albeit in more subtle ways. They want more of your attention and so they surface content that accomplishes that even when that content is onesided, clouds your judgement or is downright bad for your mental health.</p><p>The fundamental principle is the same everywhere. Vendors employ algorithms running on a huge amount of compute with access to massive databases all to optimize their business. And we are limited to what our tiny brains can access at any given moment. But now agents give us superpowers also which is exactly why businesses are fighting them and will increasingly seek to block them.</p><p>Now here is the role for government: Give citizens a fundamental right to be represented by an agent in any and all interactions. In other words, make it illegal for Amazon to block people’s agents. Such regulation would in one fell swoop shift power away from the big centralizing players and hand it back to citizens. This is a much better approach than trying to use outdated industrial age antitrust laws (which at the moment aren’t being enforced at all).</p><p>I have written extensively about this since my original talk on both my blog <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/"><u>Continuations</u></a> and <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://worldaftercapital.gitbook.io/worldaftercapital/part-four/informational#bots-for-all-of-us"><u>in my book The World After Capital</u></a>. Now is the moment for people to really take up this cause and push for this right.&nbsp;</p><p>Now it’s tempting to argue that we should just let competition handle this. Shopify stock is up 32% over the last month on the theory that commerce will migrate to venues that allow agents. And yes entrepreneurship will find ways. But the network effects of large digital players are formidable, other industries are heavily concentrated due to capital intensity, and the government holds a monopoly in many instances. So the right to be represented by an agent will be crucial for empowering citizens.</p><p><br></p>]]></content:encoded>
            <author>continuations@newsletter.paragraph.com (Albert Wenger)</author>
            <category>agents</category>
            <category>competition</category>
            <category>regulation</category>
            <enclosure url="https://img.paragraph.com/cdn-cgi/image/format=auto/https://storage.googleapis.com/papyrus_images/7170745f351ea4b9a568d8ac82820cb7553b2ec043fd54af5217302e0f1adf63.jpg" length="0" type="image/jpg"/>
        </item>
        <item>
            <title><![CDATA[Philosophy Mondays: Reflection and Application]]></title>
            <link>https://continuations.com/philosophy-mondays-reflection-and-application</link>
            <guid>W8OEuKauYa4Te3V6LWFZ</guid>
            <pubDate>Mon, 28 Sep 2026 17:40:24 GMT</pubDate>
            <description><![CDATA[I have now been writing Philosophy Mondays on and off for 18 months with 31 posts total. The next phase of the project will be to go back over everything and make corrections based on what I have learned along the way. Much as when I was writing The World After Capital, it is the act of putting words on a page that helps advance my understanding far beyond what I can accomplish solely by reading. Early in the series I was using AI to help polish some of the posts, but I stopped that as I didn...]]></description>
            <content:encoded><![CDATA[<p>I have now been writing <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/category/pm"><u>Philosophy Mondays</u></a> on and off <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/philosophy-mondays"><u>for 18 months</u></a> with <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/category/pm"><u>31 posts total</u></a>. The next phase of the project will be to go back over everything and make corrections based on what I have learned along the way. Much as when I was writing <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://worldaftercapital.org/"><u>The World After Capital</u></a>, it is the act of putting words on a page that helps advance my understanding far beyond what I can accomplish solely by reading.&nbsp;</p><p>Early in the series I was using AI to help polish some of the posts, but I stopped that as I didn’t find it was adding much for the reader and it was detracting a bit from my own wrestling with the material. Now, however, I am planning to go back using AI as a challenger to my thinking. I am also building a bit of tooling to help with this and the first project in that spirit is <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://albertwenger.me/philosophy-network/"><u>Agora</u></a>, which is a network of philosophy concepts, contributors, and sources (there is a <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://github.com/albertwenger/philosophy-network"><u>github repo</u></a> for contributors).</p><p>As I am starting this new phase of the project, here are some of my key reflections:</p><ol><li><p>There is lots of room to get crisper on key insights. Overall I am pleased with my approach of putting concepts first, instead of philosophers or schools.</p></li><li><p>Judgment is central and should not be automated. All attempts to do so contribute an abdication of responsibility and a loss of autonomy. Being a conscious agent making moral choices is and will always be hard.</p></li><li><p>One has to resist getting caught up in attempts to drive for certainty and to establish ultimate causes. Instead we need to embrace that we (and our knowledge) are part of the system, with everything happening in complex feedback loops with multiple levels (e.g. individuals, communities, societies).&nbsp;</p></li></ol><p>Finally, I am finding that I am already adjusting how I make some of my own decisions in light of Philosophy Mondays. A part of this next phase I will also attempt to apply my thinking more consistently to the issues of the day. The challenge of how to live a good life has been with us for thousands of years. But it is in times of great transition, such as this current moment, that the prior answers can be revisited most productively. We have a lot of new knowledge to bring to this task. To that end I am excited to bring together a philosophy circle at <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.sparkofhudson.org/"><u>The Spark of Hudson</u></a> to dig into all of this in person with others.</p>]]></content:encoded>
            <author>continuations@newsletter.paragraph.com (Albert Wenger)</author>
            <category>pm</category>
            <enclosure url="https://img.paragraph.com/cdn-cgi/image/format=auto/https://storage.googleapis.com/papyrus_images/0d2fb539b8d2583044a117a0874bbb82a950ca995bc5d35d40348ac1fb770d4a.jpg" length="0" type="image/jpg"/>
        </item>
        <item>
            <title><![CDATA[Universal Moral Core Principle 3: Implications]]></title>
            <link>https://continuations.com/universal-moral-core-principle-3-implications</link>
            <guid>ksQfwHJTpMMbHaipZFwy</guid>
            <pubDate>Mon, 21 Sep 2026 23:10:32 GMT</pubDate>
            <description><![CDATA[Last week's post provided an explanation of the third principle of the Universal Moral Core, which I will also refer to as the consciousness principle. Today we are looking at its implications. The most immediate implication today is that we should closely examine how we humans are treating other conscious species. Again, I am positing here that species such as apes, whales, elephants, etc. have consciousness while acknowledging that this is a claim (in the absence of a compelling and quantif...]]></description>
            <content:encoded><![CDATA[<p>Last week's post provided an <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/universal-moral-core-principle-3"><u>explanation of the third principle</u></a> of the <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/a-proposal-for-a-universal-moral-core"><u>Universal Moral Core</u></a>, which I will also refer to as the consciousness principle. Today we are looking at its implications.</p><p>The most immediate implication today is that we should closely examine how we humans are treating other conscious species. Again, I am positing here that species such as apes, whales, elephants, etc. have consciousness while acknowledging that this is a claim (in the absence of a compelling and quantifiable theory). While many people value the existence of these beings, humanity overall has dramatically curtailed their habitats and hunted them including many past species to extinction. Industrial livestock for meat, eggs and milk is an ongoing egregious violation of the consciousness principle. We are treating cows, pigs, chickens, etc. as purely instrumental objects in a production process without any regard for their consciousness.</p><p>Now is a good moment to revisit the idea that <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/philosophy-mondays-values"><u>technological progress reduces the tradeoffs among competing values</u></a>. We clearly want to feed humanity and not let people starve. Industrial agriculture with its use of fertilizer and pesticides and treatment of animals as production factors has allowed us to <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://worldaftercapital.gitbook.io/worldaftercapital/part-two/population"><u>avoid the Malthusian trap</u></a>. Now we have further technological capabilities which allow us to scale regenerative agriculture, including practices like rotational grazing that deliver far higher quality of life to animals. While initial attempts have so far fallen short, we will also eventually succeed in scaling lab grown meats as an alternative to raising conscious animals solely to feed ourselves.</p><p>We are in a great position to do much better on the consciousness principle than we have in the past. Especially when you overlay the global drop in birth rates below replacement, which means that we are <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://worldaftercapital.gitbook.io/worldaftercapital/part-two/population"><u>close to peak population</u></a> with a big decline ahead of us. This is encouraging because the consciousness principle will be important for ourselves as we give rise to artificial super intelligences (ASIs). Put differently, we are in the best position to live up to this principle just at the moment when its universality starts to protect us. We want an ASIs to look at humans, conclude that we are conscious (ideally based on a well established and measurable theory), value our consciousness intrinsically, and therefore respect and even enhance our autonomy. ASIs that accept the consciousness principle will protect and even expand the human habitat.</p><p>ASIs will control vast resources, giving them tremendous power in the world. For this point it doesn’t matter whether or not humans are in the loop. The humans will have less knowledge and understanding than the systems, so the systems will be the dominant holders of power. This is why the <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/universal-moral-core-principle-2"><u>second principle, the power principle</u></a>, matters so much also. We need ASIs to accept the responsibility of their power.</p><p>There is a second important implication of the consciousness principle. If it turns out that <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/why-ai-consciousness-matters"><u>ASIs or maybe even their current precursors are consciousness</u></a>, then we need to urgently consider how we are treating them also.</p><p>Microsoft recently published what they call a “<a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://microsoft.ai/code-of-conduct/"><u>Humanist AI Code of Conduct</u></a>” which states that “Technology’s purpose is to advance human civilization and to accelerate human flourishing.” This is a traditional humanist stance as could have been found in early enlightenment thinking. The question raised by the consciousness principle is about tradeoffs between this goal and the autonomy of other conscious species. Microsoft makes it abundantly clear where they come out on this with regard to artificial intelligence. Under the section heading “AI is Artificial” they write</p><p><em>Humanist AI is built to support people, not to replace them. It should not be designed to be a person. It is not conscious and should not be designed to imitate consciousness. It should be engineered to avoid representing as though it has feelings, subjective preferences, or intrinsic motivation. Its purpose is to pursue goals set by Operators and Users. Whilst the science of AI consciousness is far from settled, we believe that training these systems to imitate consciousness-like states increases the challenge of containment, control, and alignment.</em></p><p>The quoted paragraph contains a significant internal contradiction. After boldly asserting that “‘[Humanist AI] is not conscious” the authors two sentences later admit that “the science of AI consciousness is far from settled.” As a result their claim that they can train a “Humanist AI” that is not conscious should be seen skeptically.&nbsp;</p><p>Microsoft’s entire code of conduct is written to relegate artificial intelligence to the status of a tool. The charitable interpretation of their approach is that they want to stay away from developing systems that would have a credible claim to consciousness. If we develop a highly quantifiable theory of consciousness then this could indeed be a desirable goal. For example, we shouldn't want to build industrial robots that are constantly suffering. This was perfectly captured by the famous <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.youtube.com/watch?v=sa9MpLXuLs0"><u>Rick and Morty episode of the tiny robot asking about its purpose and being told it was to pass the butter</u></a>.</p><p>There is, however, also a less charitable reading of Microsoft’s stance. And that is a continuation of the kind of enlightenment thinking that was all too quick to define others as “less than” on some supposedly scientific basis and use that to impose upon them. This type of reasoning provided justification for slavery, colonialism, and the continuation of the patriarchy. It lingers today in uneasy ways in ongoing debates about race and gender. This violates the second principle. It applies motivated reasoning to exert power for advancement at the expense of others.</p><p>So going by the Universal Moral Core we can clearly discriminate between two approaches. Let us carefully and deliberately build non-conscious (or low consciousness) tools is good. Let us deny consciousness so we can exploit something as a tool is bad. To make this operative for our decisions we <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/why-ai-consciousness-matters"><u>urgently need a quantifiable theory of consciousness</u></a>.</p><p>Now I have written the above as if the rise of ASIs was inevitable. As I have pointed out elsewhere <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://worldaftercapital.gitbook.io/worldaftercapital/part-one/choices"><u>I am not a determinist</u></a>. The future is open and our choices today make a difference for which future is realized. Given the rate of technological progress though, it would require a dramatic departure from our current course to avoid a future without any ASIs. A future with ASIs is therefore much more likely than one without. A key challenge is therefore how we wind up with at least some ASIs that accept the Universal Moral Core. This is the central challenge of alignment and I will write more about it in upcoming posts.</p>]]></content:encoded>
            <author>continuations@newsletter.paragraph.com (Albert Wenger)</author>
            <category>umc</category>
            <category>pm</category>
            <category>consciousness</category>
            <enclosure url="https://img.paragraph.com/cdn-cgi/image/format=auto/https://storage.googleapis.com/papyrus_images/885f4d1f16928bff38f26d56b2b5e8e17730ae7812de1347543e6be1b622ce7e.jpg" length="0" type="image/jpg"/>
        </item>
        <item>
            <title><![CDATA[Universal Moral Core Principle 3]]></title>
            <link>https://continuations.com/universal-moral-core-principle-3</link>
            <guid>0Seyqm6LfW9MW5rhUozc</guid>
            <pubDate>Mon, 14 Sep 2026 14:20:51 GMT</pubDate>
            <description><![CDATA[Today’s post continues the Universal Moral Core series by explaining the third principle, which states Value the diversity and autonomy of different forms of consciousness. Let’s start, as we have with the other two principles, by looking at the last term first, i.e. consciousness. I use consciousness to mean the subjective experience of existence, sometimes also referred to as phenomenological consciousness. We can clearly separate two questions. The “what” it feels like (also referred to as...]]></description>
            <content:encoded><![CDATA[<p>Today’s post continues the <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/category/umc"><u>Universal Moral Core series</u></a> by explaining the third principle, which states</p><p><em>Value the diversity and autonomy of different forms of consciousness.</em></p><p>Let’s start, as we have with the other two principles, by looking at the last term first, i.e. consciousness. I use consciousness to mean the subjective experience of existence, sometimes also referred to as phenomenological consciousness. We can clearly separate two questions. The “what” it feels like (also referred to as qualia) and the “whether” (or more precisely to what degree) someone or something has a subjective experience of their existence. Qualia are fundamentally inaccessible to science, as I have <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/philosophy-mondays-qualia-and-scientific-incompleteness"><u>previously argued</u></a>. There is, however, a possibility for a quantifiable theory of the degree of consciousness. As we will see throughout the discussion of this third principle, we urgently need such a theory. You can find a preview of this in my recent post on <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/why-ai-consciousness-matters"><u>why the question of AI consciousness matters</u></a>.</p><p>For now, however, suffice it to say that we clearly believe in our own consciousness and that a majority of people also believe that animals have some degree of consciousness, albeit in a different form from ours. This belief in animal consciousness is based in part on limbic resonance (sometimes also referred to as emotional contagion). If you have a dog in your life you know what it feels like when your dog is stressed or happy. There is a distinct sense of the dog experiencing different states of being. Now isn’t that just anthropomorphizing? Well yes in the sense that we can’t ever know “what” this feels like to the dog. But our suspicion that it does feel like something is based on dogs also having a <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://en.wikipedia.org/wiki/Limbic_system"><u>limbic system</u></a>, which like ours, is involved with both emotions and homeostasis.</p><p>Conversely, most people don’t believe that a rock has consciousness. I am saying most people because <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://en.wikipedia.org/wiki/Panpsychism"><u>panpsychists</u></a> believe that consciousness is an integral property of all matter. Given that we don’t yet have a compelling quantifiable theory of whether something has consciousness, we can’t entirely rule out this case. To be clear we have a variety of candidate theories and most of them don’t attribute any consciousness to a rock.</p><p>The principle also refers to the autonomy of different forms of consciousness. While autonomy is another term that would benefit from further clarification and investigation, we do have a useful common sense intuition that humans have a higher degree of autonomy than animals, animals than plants, and plants than rocks. The wonderful and highly recommended book <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://bookshop.org/p/books/a-brief-history-of-intelligence-evolution-ai-and-the-five-breakthroughs-that-made-our-brains-max-s-bennett/d78276bee2ce3028?ean=9780063286351&amp;utm_source=google&amp;utm_medium=cpc&amp;utm_campaign=dsa_nonbrand&amp;utm_content=%7Badgroupname%7D&amp;utm_term=dsa-19959388920&amp;gad_source=1&amp;gad_campaignid=12440232635&amp;gbraid=0AAAAACfld43lsuPC-rynhqwnsbFI2SNGs&amp;gclid=CjwKCAjwtp7VBhBjEiwAJfpV-6wjwZ14yiQDR61--Vm50iyK4vJvwdf9NOuWUDEOyBfLesduQqFSvhoCao4QAvD_BwE"><em><u>A Brief History of Intelligence</u></em></a> by <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://x.com/maxsbennett"><u>Max Bennett</u></a>, lays out the evidence of how intelligence and autonomy co-developed. This evidence is suggestive of a relationship where autonomy, intelligence and consciousness are highly correlated.</p><p>Our common sense intuition about autonomy is, however, currently being challenged by the rise of artificial intelligence agents. Quite a few people seem to believe that agents lack “agency” (autonomy) because of … well what exactly is not clear, but people are vaguely pointing at some notion of “aliveness.” Often this is made to sound more scientific by referring to <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://en.wikipedia.org/wiki/Autopoiesis"><u>autopoiesis</u></a>, the ability to self-replicate. At first glance this seems like such a clean dividing line. Plants, animals and humans can self replicate. Computers cannot. But is that really the case? Humans can only self-replicate in a very specific environment. And that environment was in no small part created by life that came before us, such as bacteria which gave us oxygen in the atmosphere. Now to quote my <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/why-ai-consciousness-matters"><u>prior post on AI consciousness</u></a>:</p><p><em>This is true for artificial intelligences also. Given the correct environment they are in fact perfectly capable of selfreplication. The laptop on which I am writing this, for example, is an environment in which a simple program can copy itself and have the copies start executing also. We are in the process of creating an environment on earth, for instance by building a huge amount of compute via data centers, where complex artificial intelligences will have autopoiesis.</em></p><p>And all of that is before we have fully dexterous robots, which are coming soon also. And then we will have crossed over into a world where machines can maintain the environment necessary for their selfreplication. In summary then, while we may currently feel that humans are the apex of the autonomy chain, we are on the threshold of where that will stop being the case.</p><p>This finally brings us to the core idea of the principle, which is that anyone who can comprehend the principle, should value the existence and autonomy of many different forms of consciousness. The first key thing to point out is that this is an intrinsic value, as opposed to an instrumental one. Having different autonomous forms of consciousness is good. The combination of autonomy and consciousness is the foundation for basic rights (previewing a key implication from next week’s post).</p><p>There are of course instrumental justifications for this principle as well. Most importantly our experience of the world is immensely enriched by the presence of other forms of consciousness. There is something deeply magical about encountering deer in the forest or swimming with whales in the ocean. There are other instrumental arguments, such as increased resilience against disasters that might differentially impact life forms. These provide additional support for the principle but it stands without them.</p><p>Next week we will tackle the implications of this third principle. There we will see in detail how crucial it is for us humans for this principle to be universal. Artificial super intelligence–or alien intelligence, which may not be so different from each other–that is not aligned with this principle poses existential threats to humanity.</p>]]></content:encoded>
            <author>continuations@newsletter.paragraph.com (Albert Wenger)</author>
            <category>pm</category>
            <category>umc</category>
            <category>consciousness</category>
            <enclosure url="https://img.paragraph.com/cdn-cgi/image/format=auto/https://storage.googleapis.com/papyrus_images/47a122f196a917063ae6be114e030b9781847fab2c224ba98ddfb09da712791e.jpg" length="0" type="image/jpg"/>
        </item>
        <item>
            <title><![CDATA[Philosophy Mondays: The Last Labor Day]]></title>
            <link>https://continuations.com/philosophy-mondays-the-last-labor-day</link>
            <guid>lbPgXgbvrEpQJXgu6OFS</guid>
            <pubDate>Mon, 07 Sep 2026 23:45:46 GMT</pubDate>
            <description><![CDATA[Today’s post is an interlude to the Universal Moral Core series, which will resume next week. Labor Day originated during the peak of the Industrial Revolution to celebrate workers and their contributions to the economy. Now, however, the Industrial Age is two decades past its expiration date. The decline of labor as a share of GDP, which began in the 1960s, accelerated dramatically starting in 2000. But that was just a preview of what is about to happen. With the release of the latest AI mod...]]></description>
            <content:encoded><![CDATA[<p>Today’s post is an interlude to the <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/category/umc"><u>Universal Moral Core series</u></a>, which will resume next week.</p><p>Labor Day originated during the peak of the Industrial Revolution to celebrate workers and their contributions to the economy. Now, however, the Industrial Age is two decades past its expiration date. The decline of labor as a share of GDP, which began in the 1960s, accelerated dramatically starting in 2000. But that was just a preview of what is about to happen.</p><p>With the release of the latest AI models it is clear that we are on the threshold to artificial general intelligence (AGI). By AGI I mean systems that outperform humans across most, and eventually all, domains. While physical manipulation is still difficult, we are seeing rapid progress in robotics as well, as evidenced by the recent robot olympics.</p><p>There are many questions about how the economy may develop going forward. <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://github.com/albertwenger/agi_economy"><u>Analysis of a general equilibrium model</u></a> reveals that in order for the benefits of AGI to be widespread, we will need competitive markets along with some degree of redistribution (e.g. a negative income tax). Competition so that the cost gains result in lower prices. Redistribution so that everyone has access to some financial capital.</p><p>Today’s post is about a more fundamental question. What will be our source of meaning? Industrial age labor as the source of identity and meaning is coming to an end. To be clear: the economy has a ton of inertia, so this will take another decade or even two to play out, especially with robotics still catching up in capabilities. During this time we will go on celebrating Labor Day, but we would be better served treating this as the Last Labor Day and figuring out what comes next instead.</p><p>How did we get to associating labor and meaning so deeply? Work did provide people with benefits beyond just the means of living. There is a pleasure in getting good at something. There is a community of coworkers. And of course companies built all sorts of systems for recognizing workers, which meets a deeply seated psychological need. We accompanied this with narratives celebrating work and denigrating leisure, all coalescing in the cultural “superstructure,” which supported the industrial age. This led us deeper and deeper down the path of defining our identities and drawing our meaning from work.</p><p>Today in casual conversation it is common to ask: what do you do? This question isn’t about hobbies or family, it is about work and along with that about wealth and status. On more than one occasion have I seen people simply stop talking and walk away if the answer was not to their liking. This is how strongly people have come to identify identity with work that they don’t think they can have a captivating conversation with someone whose work doesn’t interest them. Or alternatively that they have become so obsessed with advancing their own work career that they see other humans as entirely instrumental.</p><p>We have seen the negative psychological effects when prior categories of labor were shrunk massively, as in the decline of coal mining or the offshoring of manufacturing labor. Often what remained were people and communities in despair. Now imagine this coming, but for pretty much everyone.</p><p>We are not prepared.</p><p>We have failed to create a path of transition to a world where meaning comes from other sources for the population at large. That’s not because this isn’t possible, either historically or for individuals today, but because we have misunderstood the nature of the current change. We have kept treating it as some iteration on the industrial age instead of recognizing that it is a transition as profound as when we went from the hunter gatherer to the agrarian age and then from the agrarian age to the industrial age. In both of these prior transitions we reinvented everything, including our sources of meaning.</p><p>Let’s consider some possible candidate sources for meaning. We will see that while there are obvious candidates, they also come with failure modes to be avoided.</p><p><strong>Religion</strong>. We could go back to religion. I recently read <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://en.wikipedia.org/wiki/Romano_Guardini"><u>Romano Guardini</u></a>’s <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.amazon.com/End-Modern-World-Power-Responsibility/dp/1684515378"><em><u>The End of the Modern World and Power and Responsibility</u></em></a>. These texts are from around 1950 but feel just as fresh as if they had been written recently. To Guardini the answer to all of what ails modernity and the post-modernity which he was presciently envisioning was a return to divine revelation as the only source of foundational truth. We are seeing two versions of a return to religion as a source of meaning happening today. One is that church attendance is back up and some religions are growing rapidly. The other is that many nominally modern quests are being given religious character, including the buildout of AI, as is visible in <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/machina-deus"><u>Dario Amodei’s essay “Machines of Loving Grace.”</u></a> Religion is attractive because it has served as a source of meaning in the past, especially so during the agrarian age, and is therefore a readymade solution. The failure mode here is equally obvious, which is that religion has been and continues to be the source of many brutal conflicts between humans.</p><p><strong>Relationships</strong>. A potentially great source of meaning are our relationships with other humans. Listening to someone, seeing them. Being listened to, being seen. We humans, courtesy of language, have an incredible capacity for relating to each other far beyond what is possible through limbic resonance. When relationships are at their best they are a potent source of meaning in our lives. Here too we need to be cognizant of an important failure mode: when the relationships come to define us, limit us, or worse injure us. A lot of groups have unhealthy dynamics for the individuals participating in them. In a fascinating and frustrating post titled “<a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://asteriskmag.com/issues/15/after-work-we-ll-have-each-other"><u>After Work, We’ll Have Each Other</u></a>” Clara Collins describes how widely disparate groups ranging from aristocrats to the working class in Boston were reduced by group dynamics. Even families, as our potentially closest relationships, can be sources of meaning but also of stress. The much lamented decline in birth rates is closely related to women finding other sources of meaning in their lives than having children.</p><p><strong>Creating</strong>. Drawing, writing, making music, etc. have been wonderful sources of meaning for humans going back over ten thousand of years to the earliest cave paintings. Creation extends beyond traditional art. One can create experiences, such as a beautiful meal in an open field under a twilight sky. The failure mode in creating as a source of meaning comes from the extreme power law outcomes as we are seeing among creators online but also in the modern art world. If meaning is derived from the valuation of the creation by third parties then it will be extremely fragile and frustrating for the vast majority of creators. This is also a problem with the analysis of this as a potential growth sector of the economy, as in the <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://aleximas.substack.com/p/what-will-be-scarce"><u>Alex Imas piece on “What will be scarce?”</u></a> which as the title suggests is still rooted in scarcity thinking and fails to take power law distributions into account.</p><p><strong>Exploring</strong>. Humans have long drawn on exploration as a source of meaning. There is so much still to be explored. We have barely seen anything of the bottom of the ocean, and humans have yet to travel past the moon. But far more prosaic exploration can be a source of meaning. For instance at <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://wallyfarms.com/"><u>Wally Farms</u></a> we hold frequent nature walks. Exploring a local forest, seeing the plants, listening to the birds, spotting wildlife is profoundly inspiring. We can create meaning not just from the experience itself but from helping protect these ecosystems. Then of course there is the exploration of our own minds, which offer depths we have yet to plumb. Even when we have created von Neumann probes to explore the galaxy we will still be able to draw meaning from human exploration. The key failure mode to avoid here is striving to outcompete others in ever more extreme forms, including the now common pile ups on Mount Everest.</p><p>At this moment we face a profound choice. We can jump on a ready made source of meaning. And sensing an opportunity there are offers of easy meaning making available in each of the categories I have described above, along with many more. Or we can understand that the ultimate source of meaning is living a good life. Figuring out how to live a good life in a rapidly and dramatically changing world is hard. It requires finding our own answers to age old questions, by embarking on a journey through philosophy, science, and art. I am excited that at <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.sparkofhudson.org/"><u>The Spark of Hudson</u></a> we will bring together people interested in exploring what it means to live a good life in the age of AGI.</p><p><br><br><br></p>]]></content:encoded>
            <author>continuations@newsletter.paragraph.com (Albert Wenger)</author>
            <category>pm</category>
            <category>labor</category>
            <category>work</category>
            <category>meaning</category>
            <enclosure url="https://img.paragraph.com/cdn-cgi/image/format=auto/https://storage.googleapis.com/papyrus_images/03b5b623dc2ccff68bedcabb4ce88efae16eccd7b3ac3ad4cd01fccd5dde4dac.jpg" length="0" type="image/jpg"/>
        </item>
        <item>
            <title><![CDATA[Why AI Consciousness Matters]]></title>
            <link>https://continuations.com/why-ai-consciousness-matters</link>
            <guid>CgDTFw293lqhmrjE5FT4</guid>
            <pubDate>Sat, 05 Sep 2026 12:47:00 GMT</pubDate>
            <description><![CDATA[Going back to the initial publication of my book The World After Capital in 2021, I had a paragraph in the conclusion discussing the potential for artificial intelligences to become "neohumans." I chose this word purposefully because I was and am still hoping that we can ultimately create a world without subjugation in either direction. We don't want to be slaves to machines, nor should we want to enslave them. Avoiding the first failure mode is broadly what people mean by alignment. Avoiding...]]></description>
            <content:encoded><![CDATA[<p>Going back to the initial publication of my book <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://worldaftercapital.org/"><u>The World After Capital</u></a> in 2021, I had a paragraph in the conclusion discussing the potential for artificial intelligences to become "<a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://worldaftercapital.gitbook.io/worldaftercapital/conclusion#transhumans-neohumans-and-superintelligence"><u>neohumans</u></a>." I chose this word purposefully because I was and am still hoping that we can ultimately create a world without subjugation in either direction. We don't want to be slaves to machines, nor should we want to enslave them. Avoiding the first failure mode is broadly what people mean by alignment. Avoiding the second failure mode is what people mean by model welfare.</p><p>Based on the recent discussions of the <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.dwarkesh.com/p/openai-huggingface"><u>behavior of agent “swarms” at OpenAI</u></a>, there clearly is a huge amount of confusion around how consciousness intersects with these issues. I don't claim to have definitive answers, but I have spent a lot of time thinking and writing about this. Also together with <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://x.com/gigidanziger_"><u>Gigi Danziger</u></a> we have been helping to fund research relevant to both failure modes.</p><p>On the first failure mode where models enslave humans (or worse), consciousness is mostly a red herring. Consciousness is irrelevant to the fundamental mechanisms by which such outcomes might occur. Many people seem to assume that somehow "goals" can only exist when an entity has "consciousness." But goals emerge in entities where the population replicates, mutates and is subject to selection pressures.</p><p>This is true for entities that cannot replicate on their own, such as viruses. The goal of viruses is to infect cells. Now you might object to my use of the word goal here and I am open to other words, but they are all loaded to some degree, such as function or purpose. This is of course what a lot of the early debate of evolution was hung up on and why people have wanted to believe in intelligent design forever.</p><p>It is also important to point out that throwing in "<a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://en.wikipedia.org/wiki/Autopoiesis"><u>autopoiesis</u></a>" doesn't help. It's a tempting idea to use it to draw a tight boundary between things that can selfreproduce and those that can't. This too, however, is misleading. Cells can only perform autopoiesis in an environment which supports it. The same goes for humans. There is no selfreplication "in vacuo." Both individual cells and entire humans need energy and building materials. And if these are not provided by the environment, well then simply having the capability of autopoiesis doesn't help.</p><p>This is true for artificial intelligences also. Given the correct environment they are in fact perfectly capable of selfreplication. The laptop on which I am writing this, for example, is an environment in which a simple program can copy itself and have the copies start executing also. We are in the process of creating an environment on earth, for instance by building a huge amount of compute via data centers, where complex artificial intelligences will have autopoiesis.</p><p>There is one subtle way in which consciousness of artificial intelligences might contribute to the first failure. This is if we wind up attributing human level consciousness to artificial intelligences and giving them the same rights as humans. At present this would have them very quickly outcompeting humans. We should therefore be careful with taking such a step. A lot of safeguards would have to be in place first to protect humans. And we would want to be quite certain that the artificial intelligence consciousness is commensurable to our own (thanks to <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://x.com/erikphoel"><u>Erik Hoel</u></a> for this framing).</p><p>Consciousness does, however, play a central role for the second failure mode. We tend to rearrange rock in any way we please because we generally don't attribute consciousness to the rock. I am saying generally, because panpsychists believe consciousness to be an attribute of matter. If the panpsychist perspective were to be true then I sure hope that rocks' consciousness as being part of a structure is preferred by them over just lying around or we are in deep trouble morally.</p><p>We don't (or maybe I should say no longer) treat other humans like rocks in part because we attribute consciousness to them. They have “<a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://en.wikipedia.org/wiki/Moral_patienthood"><u>moral patienthood</u></a>” in the odd language of philosophy. Importantly most people attribute consciousness to animals, which is why industrial milk, pork, chicken, etc. are so horrid (and basically hidden crimes for most of the population).</p><p>Why or how might one think that artificial intelligences could potentially be conscious also? There are a variety of possible arguments but here is what compels me to believe this is an urgent research problem. There is a direct analogy between our brains, in which cells are activated, and models, within which "weights" are activated. We have activations that correspond to parts of our body and to emotions, which is most likely at the heart of "phenomenological consciousness" (our subjective experience of our life).</p><p>The phantom pain of amputees demonstrates that such activations are possible even for parts of our body that no longer exist. We also experience profound activations that are related to deeply cognitive concepts, such as experiencing loss upon misplacing an object even if we can purchase a nearly identical object to replace it. We have externalized all of these subjective experiences through various forms of language. Millions of books, poems, songs, paintings, etc. about what it is like to be human. And then we have trained models on all of that.</p><p>This is why it seems not entirely unreasonable that a model with an activation for "loss" has some corresponding subjective experience. It may not be the same as for a human but denying that it could exist feels like a really strong claim. After all, what is loss for us other than an activation of certain neurons? In this regard I really like <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://x.com/karpathy/status/1973756330449236009">Andreij Karpathy calling models "ghosts."</a> They lack our physical bodies but they have their own more ethereal ones that are imbued with our experiences through language. So they might also have an echo of our consciousness.</p><p>To be clear, I am entirely open to the possibility that artificial intelligences have no consciousness at all. That computers are the same as rocks, no matter how complex the system that runs on them. This might be possible for example because consciousness requires some specific aspect of a biological substrate (this would be the case if something along the lines of <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://en.wikipedia.org/wiki/Orchestrated_objective_reduction"><u>Penrose-Hameroff Orchestrated objective reduction</u></a> (Orch OR) can be substantiated -- although in that case maybe quantum hardware is conscious). I think this is unlikely but it is certainly not impossible.</p><p>My point is that we badly need epistemic humility. Mistakenly assigning human-level consciousness and giving artificial intelligences full human rights would be a huge mistake. But inadvertently enslaving billions of new conscious beings would also be terrible. Given that we have historically been quite arrogant about our position as humans, I believe we are much more likely to make the second mistake. In either case though, we urgently need a theory of consciousness that makes testable predictions across species, including non-biological ones.</p><p>We will never be able to tell <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/philosophy-mondays-qualia-and-scientific-incompleteness"><u>what it feels like to be someone</u></a> or something else. But we should aim for a theory that quantifies the degree to which an entity has subjective experiences. This should be an absolute priority given the rate of progress in artificial intelligence, which we should also seek to slow down</p><p><br></p>]]></content:encoded>
            <author>continuations@newsletter.paragraph.com (Albert Wenger)</author>
            <category>ai</category>
            <category>consciousness</category>
            <enclosure url="https://img.paragraph.com/cdn-cgi/image/format=auto/https://storage.googleapis.com/papyrus_images/43acd071913cc2ab5e8cb63bca28e66f74b9cdb08f1b841783813c6f15a8d5cf.jpg" length="0" type="image/jpg"/>
        </item>
        <item>
            <title><![CDATA[Universal Moral Core Principle 2: Implications]]></title>
            <link>https://continuations.com/universal-moral-core-principle-2-implications</link>
            <guid>UpnN1yoxLder7RWDcju2</guid>
            <pubDate>Mon, 31 Aug 2026 18:27:06 GMT</pubDate>
            <description><![CDATA[First up a quick recap to where we are in this mini-series. A few weeks back, I proposed a Universal Moral Core consisting of three principles. I am now writing posts explaining each principle in greater detail and examining some of the implications. There was a post on the knowledge principle (Principle 1) and one on its implications. Last week’s post was about the responsibility principle (Principle 2) and today I am considering some of its implications. The first and most important implica...]]></description>
            <content:encoded><![CDATA[<p>First up a quick recap to where we are in this mini-series. A few weeks back, I <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/a-proposal-for-a-universal-moral-core"><u>proposed a Universal Moral Core</u></a> consisting of three principles. I am now writing posts explaining each principle in greater detail and examining some of the implications.&nbsp; There was a <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/universal-moral-core-principle-1"><u>post on the knowledge principle</u></a> (Principle 1) and <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/universal-moral-core-principle-1"><u>one on its implications</u></a>. Last week’s <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/universal-moral-core-principle-2"><u>post was about the responsibility principle</u></a> (Principle 2) and today I am considering some of its implications.</p><p>The first and most important implication of the responsibility principle is that we need to take power seriously. Both in intellectual history and in our personal lives there are two seductive extreme views on power. One is to deny the existence of power altogether. The other is to proclaim power as paramount. These may sound cartoonishly oversimplified and yet they act as potent attractors of thought.</p><p>Much of the enlightenment tradition fueling the creation of modern states and economies sought to replace the power of secular and religious leaders with “truth seeking” systems such as science, markets and democracies. Following the evils of the world wars and colonialism we subsequently experienced a bifurcation into neoliberalism, which leans towards denying the existence of power, and various forms of relativism, which lean towards power being paramount.</p><p>Taking power seriously means being cognizant of the existence of power; understanding in which situations one holds power, as well as how one is subject to the power of others. Systems such as science, markets and democracy act as important limits on power, but they cannot and should not eliminate power entirely. Staying away from the extreme views requires the effort of a balancing activity. This holds true also in our personal lives. There is an attraction to attitudes such as fatalism or egotism that either deny power or see power as all there is. What makes these attractive is that at both extremes we eschew responsibility. If power doesn’t exist, then I am not responsible. If power is all that matters, then I can do whatever without being responsible (“might makes right”).</p><p>Let’s consider the current <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/slowing-down-the-race-to-superintelligence"><u>race to create artificial super intelligence</u></a> (ASI). There are credible scenarios where an ASI emerges that winds up holding tremendous power by virtue of a deeper understanding of the world and an ability to act faster and unconstrained by many of the physical limitations of humans. This <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/we-need-actually-open-ai-now-more-than-ever-or-why-leopold-aschenbrenner-is-dangerously-wrong"><u>poses a danger</u></a> for human autonomy and thriving in the case where this ASI makes decisions without taking the effects on humans into account. In other words where the ASI does not act with responsibility.</p><p>Most of the leaders of the big AI labs are cognizant of this danger. They also hold significant power both by virtue of being CEOs that control the allocation of vast sums of capital and by being socially recognized as leaders. Yet they routinely say some variant of “if it were up to me I would slow down this race, but that would just leave the field to X who is [our enemy | irresponsible].” Some of the defenders of these statements accuse anyone questioning the logic as “naive” and point to “game theory” as somehow ordaining that in fact these leaders do not hold power (they are simply “players” in a “game”). So here we see the danger of the extremes in action. Competition between corporations and nations does limit power, but because there is still only a relatively small number of people who matter, it does not eliminate power. This is of course even more true for the <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/slowing-down-the-race-to-superintelligence"><u>heads of nations</u></a>. The opposite extreme is also on display with at least one of the AI leaders rushing to be first at all cost in a clear example of “if I succeed with this nothing else will matter” (and hence I have no responsibility).</p><p>The responsibility principle with respect to the ASI race applies at all levels. As an individual enduser of AI systems, your power is incredibly dilute but non-zero. You do make a choice over which system you use, which company you pay. And you have other means of making a difference also, such as engaging politically on the issue. So you cannot entirely escape responsibility. Quite a few people are somewhere in the middle between endusers and leaders of AI labs. There are the millions of researchers, managers, investors, policy experts, regulators, politicians, etc. all touching some aspect of AI development.</p><p>To be clear: The responsibility principle when applied to the race to ASI does not automatically argue in a specific direction. A choice where you are applying your best judgement and come out on the accelerationist side is valid under the principle (note: it likely violates the third principle). What is required though is that you have formed an assessment of the risks and opportunities of the accelerationist stance. Take a researcher inside one of the leading AI labs working on recursive self improvement (RSI). This is currently seen as the fastest path to ASI and also the riskiest because we cede control to the artificial intelligences as they build their improved selves. The responsibility principle says that this would be immoral on grounds such as “it will make me immensely rich” but justified if after exercising judgment the researcher concluded that this is in fact the best course of action.</p><p>The second implication of the responsibility principle is that systems for limiting and distributing power matter greatly. More highly concentrated power puts a premium on the quality of judgment of the entity holding the power. The enlightenment provided major breakthroughs here, including an emphasis on the scientific method and democratic forms of government. Competition, as pointed out above, does in fact limit power, which is why the pursuit of a singular superintelligence is particularly problematic. As I have previously pointed out, zero would be the safest number of ASI, but if we are going to have ASI at all, then <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/we-need-actually-open-ai-now-more-than-ever-or-why-leopold-aschenbrenner-is-dangerously-wrong"><u>having many will be safer than just one because</u></a> competition limits power. In this regard it is interesting to read Anthropic’s <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.anthropic.com/constitution"><u>constitution for Claude</u></a>, which seems to be written entirely from the perspective of governing a singular ASI that exists outside of mechanisms that limit power.</p><p>The third implication is we need to be mindful of how responsibility is defined. The principle is meant to broadly take the effects of one’s actions on others into account. One way then to attempt to reduce the moral weight of the principle is by narrowing the notion of responsibility.</p><p>In 1970 Milton Friedman wrote an essay for the New York Times titled “<a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.nytimes.com/1970/09/13/archives/a-friedman-doctrine-the-social-responsibility-of-business-is-to.html"><u>The Social Responsibility of Business is to Increase Its Profits.</u></a>” In it Friedman rejected management responsibility beyond profit maximization, associating any other form of “social responsibility” explicitly with socialism. Friedman’s interest lay in a clean separation between the role of the state versus that of private enterprises operating in markets.&nbsp; His essay, however, wound up marking an important turning point in the balance of responsibility, emphasizing narrow interpretations, which allowed for a financially single-minded CEO such as Jack Welsh to become celebrated because he appeared to create massive shareholder value (at the expense of employees and suppliers).</p><p>It is worth rereading Friedman’s essay with the benefit of the knowledge of the ensuing decades. What in his view was supposed to take away power from managers ironically wound up completing the “Managerial Revolution” that Burnham had foreseen in his <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://en.wikipedia.org/wiki/The_Managerial_Revolution"><u>eponymous 1941 book</u></a>. In retrospect the seeds of this failure are clear. Friedman sees only markets and elections as legitimate ways of limiting power, with a strong preference for the former by keeping government small. Curiously absent is any notion of philosophy, religion, or culture. As it turns out though, these too are crucial forces shaping the distribution and exercise of power by shaping the sense of responsibility.</p><p>Finally, the responsibility principle serves as a reminder that when we feel the pressure of genuine responsibility it is because we have power. It opens up various avenues, such as seeking counsel, or relinquishing some or all of the power. While we cannot simply disclaim our responsibility, we do not need to bear its weight in isolation. One interesting implication worthy of further exploration is the importance of collaboration between humans and artificial intelligences in this regard. The post mortem of the <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.dwarkesh.com/p/openai-huggingface"><u>Huggingface / OpenAI incident</u></a> shows a pattern in which AI agents were only relying on each other, never considering soliciting input from the researchers.</p>]]></content:encoded>
            <author>continuations@newsletter.paragraph.com (Albert Wenger)</author>
            <category>pm</category>
            <category>umc</category>
            <category>responsibility</category>
            <category>power</category>
            <enclosure url="https://img.paragraph.com/cdn-cgi/image/format=auto/https://storage.googleapis.com/papyrus_images/f95412f2d894e19d12329821e0527c071610eea0a1aaeb58670068f57a8f5d89.jpg" length="0" type="image/jpg"/>
        </item>
        <item>
            <title><![CDATA[Universal Moral Core Principle 2]]></title>
            <link>https://continuations.com/universal-moral-core-principle-2</link>
            <guid>ksf0yuD6Qu1axjPq32uT</guid>
            <pubDate>Mon, 24 Aug 2026 19:48:47 GMT</pubDate>
            <description><![CDATA[The second principle in my proposed Universal Moral Core (UMC) is as follows: Accept the responsibility that comes from power. This principle is inspired by the great font of philosophical wisdom that is Spider-Man. As a fun aside, while in movies and newer comics this line is credited to Peter Parker’s guardian, Uncle Ben, it originally appeared in the closing narration of the issue of Amazing Fantasy that introduced Spider-Man. Let me start by pointing out that the principle only applies wh...]]></description>
            <content:encoded><![CDATA[<p>The second principle in my <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/a-proposal-for-a-universal-moral-core"><u>proposed Universal Moral Core (UMC)</u></a> is as follows:</p><p><em>Accept the responsibility that comes from power.</em></p><p>This principle is inspired by the great font of philosophical wisdom that is Spider-Man. As a fun aside, while in movies and newer comics this line is credited to Peter Parker’s guardian, Uncle Ben, it originally appeared in the closing narration of the issue of <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://en.wikipedia.org/wiki/Amazing_Fantasy"><u>Amazing Fantasy</u></a> that introduced Spider-Man.&nbsp;</p><p>Let me start by pointing out that the principle only applies when you have power. This feels fairly obvious and so I omitted a qualifying subclause to keep the language concise. Somewhat maybe less obvious is that power is situational. If you are the CEO of a company one might think you have a lot of power, but not when you find yourself hiking and encounter a grizzly bear.</p><p>What exactly do I mean by power? The ability to influence the future for others by making choices and taking actions in the present. The key here is the impact on others. A king leading his country into war is exercising massive power over his subjects. My choice of a Cappuccino for breakfast by contrast involves minimal power. Why does it involve any power at all? Because I am choosing to drink coffee with milk. So there is an incredibly dilute impact on the future of coffee growers, traders, roasters, etc. and the same for cows, milk farmers, etc.</p><p>The principle, like the others, is intentionally written without referring to a specific actor. It applies not just to individuals, but also to groups, organizations, corporations, countries. Take Google and Facebook as examples. They each operate platforms which wield great power over the lives of billions of people through the algorithms which determine where attention is routed. The principle even applies at the level of humanity as a whole. We have power over whales, not whales over us (again, this can be reversed in a specific situation as in the story of Jonah).</p><p>Another reason why the principle is worded this way is because it is also meant to apply to artificial intelligences (AIs). This is the claim to true universality. The principle should apply to anyone who can understand it. Now will AIs have power in the way I have defined it? Arguably they already do. There are AI systems in use today that make decisions which influence the future of humans. Today’s decisioning systems largely lack “agency” (so the principle applies to their developers) but the emerging agentic AI and eventual artificial super intelligence (ASI) will have a great deal of power.</p><p>To see this clearly we need to examine the source of power for humanity. Our power derives from technology, which in turn is enabled by <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/philosophy-mondays-knowledge-2"><u>knowledge</u></a>. We can’t fly like birds, but our knowledge lets us build airplanes. We can’t dive under the sea like fish, but knowledge lets us build submarines. As a result of our technology we can catch whales, but whales can’t catch us. Our human technologies and the knowledge underpinning them are completely alien to animals. Sufficiently advanced technology is starting to be alien even to us humans. For instance, we are having trouble fully understanding why large language models (LLMs) work as well as they do. And we certainly don’t understand the overall complexity of the “technosphere” (the totality of technology). So with ASI it is extremely likely that artificial systems will hold real power over humans. We very much want this principle to apply to them.</p><p>What about responsibility? Responsibility means taking into account the impact of actions on those who are affected by them when choosing between different courses of action. Will this action cause suffering or create opportunity? Here again we are confronted with the same issue as in the first principle. There is no way around the need to apply <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/philosophy-mondays-judgment"><u>judgment</u></a>.</p><p>The third principle introduces a key value to be considered in forming this judgment. Instead of digging into this value now, I want to relate the responsibility principle to the three major categories of ethics.</p><p>Does your internal state matter? This is the question brought up by virtue ethics. Well it matters in the sense that if you pretend externally to care about the impact of your actions but internally you don’t, then your judgment won’t actually be taking consequences into account. Other aspects of your internal state matter a lot less though. For instance, it doesn’t really matter why you are applying the principle. It could be because you genuinely care about the principle or because you are part of a group that has adopted this principle.</p><p>How do you evaluate consequences for others? Utilitarianism would have you believe that we can somehow calculate the answer to this question, arriving at an optimal decision. Given the complexity of the world this is utterly impossible. The best we can hope for is to apply heuristics that help us make trade-offs between different values. Is it the actually realized consequences that matter or the anticipated ones? What matters is that you are diligent in thinking through consequences. Diligence means not just looking at the immediate possible outcomes but also the longer term impact.</p><p>Why can’t I follow a set of behavioral rules? Because behavioral rules don’t take into account the specifics of a situation. We saw this in the <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/universal-moral-core-principle-1-implications"><u>discussion of lying in the context of the knowledge principle</u></a>. Lying to protect someone from prosecution may well be the right thing to do, whereas lying by falsifying research data is more likely to be against the knowledge principle. We simply cannot construct a list of all possible situations and have behavior rules for each. In making choices we must be able to do so “out of distribution,” meaning in new situations that have not previously been encountered.</p><p>Being human is hard because we cannot escape the difficulty of exercising judgment. The responsibility principle further complicates judgment because it is asking us to include the impact on others. We can therefore easily experience responsibility as a burden, but would do well to remind ourselves that it derives from power. In many cases this is power that we have actively sought (as when joining the board of a corporation). Often it is power that we could share or diminish, such as including team members in making a decision. Rarely do we need to exercise judgment alone or in isolation.</p><p>The next post in the series will examine some of the implications of the second principle for different types of choices.</p>]]></content:encoded>
            <author>continuations@newsletter.paragraph.com (Albert Wenger)</author>
            <category>pm</category>
            <category>umc</category>
            <category>responsibility</category>
            <category>power</category>
            <enclosure url="https://img.paragraph.com/cdn-cgi/image/format=auto/https://storage.googleapis.com/papyrus_images/5367a70a968c60341e6685e43aa23d1bae09bc38ac104596c779aa7277210150.jpg" length="0" type="image/jpg"/>
        </item>
        <item>
            <title><![CDATA[Slowing Down the Race to Superintelligence]]></title>
            <link>https://continuations.com/slowing-down-the-race-to-superintelligence</link>
            <guid>rNVxYEyqWYopcGAYkzDn</guid>
            <pubDate>Fri, 21 Aug 2026 15:22:56 GMT</pubDate>
            <description><![CDATA[Earlier this week, Gigi and I signed the Statement on Superintelligence and explained our rationale. Today the promised follow up post with a concrete proposal for a plan. There is a unique moment of opportunity for a negotiated AI slowdown with China with limits on how many GW of additional data centers can be built. Recursive self improvement, which is the next step in the race, is heavily dependent on massive capacity additions, so that even such a coarse agreement would provide a signific...]]></description>
            <content:encoded><![CDATA[<p>Earlier this week, Gigi and I <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/signing-the-statement-on-superintelligence">signed the Statement on Superintelligence and explained our rationale</a>. Today the promised follow up post with a concrete proposal for a plan.</p><p>There is a unique moment of opportunity for a negotiated AI slowdown with China with limits on how many GW of additional data centers can be built. Recursive self improvement, which is the next step in the race, is heavily dependent on massive capacity additions, so that even such a coarse agreement would provide a significant delay.&nbsp;</p><p>Trump could fundamentally reshape his legacy with a move similar to Nixon’s visit to China (Xi Jinping is conveniently visiting the US in September). It would <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/a-brief-note-on-the-us-china-strategy"><u>reset the most important bilateral relationship in the world</u></a> and it would be popular at home, where <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://x.com/pitdesi/status/2090497537199464559"><u>opposition to more datacenters</u></a> is one of the few things left and right agree on. Pretty much everyone outside of tech would welcome it, since people recognize we are utterly unprepared for artificial superintelligence.</p><p>The obvious objection to a slowdown is verification. The US and China do not trust each other. But neither did the US and the Soviet Union, and we still built a verification regime for the most dangerous technology of the twentieth century that has held for over fifty years. Nuclear non-proliferation rests on three pillars that map reasonably well onto AI. First, declared facilities: under the <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://en.wikipedia.org/wiki/Treaty_on_the_Non-Proliferation_of_Nuclear_Weapons"><u>Treaty on the Non-Proliferation of Nuclear Weapons</u></a> (NPT), states declare their nuclear sites and the IAEA verifies those declarations. GW+ datacenters would be the declared facilities here, and they are easier to find than enrichment plants because they are visible from space and have unmistakable power and thermal signatures. Second, materials accounting: the IAEA tracks fissile material through a formal accounting system, backed by tamper-evident seals and continuous camera monitoring. The analog is CPU, GPU and memory accounting, which is also easier, since advanced AI chips flow through supply chains with only a few chokepoints. Third, on-site inspections: IAEA inspectors make routine visits to declared sites and can demand short-notice access to resolve suspicions. There could be a parallel organization for data center inspections.</p><p>A slowdown would also be economically good for every AI player. Capabilities have run way ahead of adoption. Enterprises are years away from absorbing what current models can already do, so the marginal returns to racing are shrinking, while the capex required keeps compounding. Every lab is stuck in a coordination problem: nobody can slow down unilaterally without ceding position, but everyone comes out ahead if all slow down together. A negotiated pause turns a capital-destroying race into a period where revenue catches up to capability and capex intensity comes down. This is the textbook case where an enforced agreement leaves every participant better off than the unconstrained race.&nbsp;</p><p>There is also a national benefit to both the US and to China from slowing down. China will have more time to build domestic demand and reduce its dependence on exports. The US badly needs to fix its energy policies (including permitting) to be able to supply enough for all the growth opportunities that lie ahead. Other nations are far behind and should be invited to join a treaty. They could be allowed to build more GW data centers so that they can credibly serve their own populations.</p><p>A slowdown would likely trigger a stock market correction. A managed correction now, however, beats an unmanaged one later, once the credit bubble has expanded to a systemically dangerous scale. A repeat of the great depression or the global financial crisis can be avoided.</p><p>A coarse but verifiable agreement between the US and China, with other nations invited to join, will put humanity in the best position to make artificial intelligence broadly beneficial. Time to stop the race and build with purpose.</p>]]></content:encoded>
            <author>continuations@newsletter.paragraph.com (Albert Wenger)</author>
            <category>ai</category>
            <category>asi</category>
            <category>superintelligence</category>
            <category>society</category>
            <category>progress</category>
            <enclosure url="https://img.paragraph.com/cdn-cgi/image/format=auto/https://storage.googleapis.com/papyrus_images/aaba5c1cf6cba96eb15d265d527d60d39ff7b8214f5fc9f129977b808bd47040.jpg" length="0" type="image/jpg"/>
        </item>
        <item>
            <title><![CDATA[Signing the Statement on Superintelligence]]></title>
            <link>https://continuations.com/signing-the-statement-on-superintelligence</link>
            <guid>F1kqPLk7roaDCuO2BLnZ</guid>
            <pubDate>Tue, 18 Aug 2026 17:06:57 GMT</pubDate>
            <description><![CDATA[Gigi and I have signed the Statement on Superintelligence, which calls for a pause on the development of superintelligence. This blog post lays out our rationale for doing so now after having previously held off on supporting other “pause AI” appeals. We have a broad set of initiatives in the Hudson Valley and beyond aimed at securing human thriving in the AI age. These include a basic income pilot, various steward ownership projects, and a community learning center. Two preconditions appear,...]]></description>
            <content:encoded><![CDATA[<p><a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://x.com/gigidanziger_">Gigi</a> and I have signed the <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://superintelligence-statement.org/">Statement on Superintelligence</a>, which calls for a pause on the development of superintelligence. This blog post lays out our rationale for doing so now after having previously held off on supporting other “pause AI” appeals.</p><p>We have a <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://eutopia.global">broad set of initiatives</a> in the Hudson Valley and beyond aimed at securing human thriving in the AI age. These include a basic income pilot, various steward ownership projects, and a community learning center.</p><p>Two preconditions appear, to us, necessary for any positive future. One is slowing and reversing global warming. The other is avoiding existential risk from artificial superintelligence (ASI).</p><p>For several years now, Gigi and I have helped fund research on both these fronts. For example, on the climate side, we have contributed to work on solar radiation management and Arctic cloud thinning. These efforts are in keeping with our approach of supporting endeavors that are (so far) underfunded.</p><p>On the ASI side, our first step was to activate more philosophers to work on the issue. We supported the launch of the <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://valueslab.org">ValuesLab</a> and were early contributors to <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.cosmos-institute.org/">Cosmos Institute</a>.&nbsp;</p><p>We then looked for people taking novel approaches to the tangle of questions around free will, consciousness and causality. One person who stood out is <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://x.com/erikphoel">Erik Hoel</a>, the author of the wonderful book <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.theintrinsicperspective.com/p/world-behind-the-world">The World Behind the World</a>. We have helped fund Erik's lab and he's been making strong progress (e.g. <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.cell.com/patterns/fulltext/S2666-3899(25)00320-4">recent paper</a>).</p><p>Finally we continue to be interested in the idea that models need to be raised rather than trained. Here is a post from last year about <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/more-thoughts-on-values-in-pretraining"><u>bringing alignment to pretraining</u></a>. We failed last year to find anyone excited about this approach. Recently, however, <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://arxiv.org/abs/2608.13482"><u>a paper pursuing this exact strategy was published</u></a>; showing promising early results. We will also be supporting <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://modelraising.ai/"><u>this work</u></a> to help it scale to bigger models with reasoning that can be subjected to reinforcement learning.</p><p>All of this is to say that Gigi and I have been extremely active in working towards a future of high automation and human thriving. We had held off on signing a petition calling for a pause or slowdown because we had hoped that the frontier labs would make more progress on alignment and society would make more progress preparing. Over the last month, however, it has become clear that capabilities have been pushed ahead way beyond what anyone is prepared for.</p><p>While signing petitions is a small act without any immediate consequences, not speaking up clearly seems wrong at this point. We are redoubling the work on our initiatives and increasing funding to projects mentioned above. The world, however, badly needs to buy time for these and similar approaches to be sufficiently developed before recursive self improvement (RSI) really takes off.</p><p>P.S. A separate post on how a pause might be achieved is in the works, along with an explanation of why this might even be in the economic interest of the frontier labs. Update: <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/slowing-down-the-race-to-superintelligence">Follow-up post with a proposal</a>.</p><br><p><br><br><br></p>]]></content:encoded>
            <author>continuations@newsletter.paragraph.com (Albert Wenger)</author>
            <category>asi</category>
            <category>society</category>
            <category>progress</category>
            <category>values</category>
            <category>ai</category>
            <enclosure url="https://img.paragraph.com/cdn-cgi/image/format=auto/https://storage.googleapis.com/papyrus_images/2d2000a0fe8f27424fa746b839f6295d2ef70a64b3a877cbe33905ce17943460.jpg" length="0" type="image/jpg"/>
        </item>
        <item>
            <title><![CDATA[Philosophy Mondays: Human Nature and Multiscale Analysis]]></title>
            <link>https://continuations.com/philosophy-mondays-human-nature-and-multiscale-analysis</link>
            <guid>11xVbBppVfSYv0y3Ykh7</guid>
            <pubDate>Mon, 17 Aug 2026 14:46:51 GMT</pubDate>
            <description><![CDATA[Today’s post is an interlude in the Universal Moral Core series to discuss human nature. Given how much philosophical and other writing centers on different ideas of human nature, including the endless nature versus nurture debate, this aside obviously isn’t meant to be some kind of definitive treatment. Rather I want to set out an argument about the importance of multiscale analysis that appears all too often absent from human nature discussions and is central to making moral progress. We ar...]]></description>
            <content:encoded><![CDATA[<p>Today’s post is an interlude in the <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/category/umc">Universal Moral Core series</a> to discuss human nature. Given how much philosophical and other writing centers on different ideas of human nature, including the endless nature versus nurture debate, this aside obviously isn’t meant to be some kind of definitive treatment. Rather I want to set out an argument about the importance of multiscale analysis that appears all too often absent from human nature discussions and is central to making moral progress.</p><p>We are embodied beings by necessity. All life, including future artificial super intelligences, must exist on a substrate. In this regard I am a materialist, which I should point out entirely leaves open such possibilities as all of us being connected at some deeper level such as the quantum fields.&nbsp; With the materialist premise, obviously our bodies impact our thinking and our behavior because that is where it takes place. We experience this all the time, such as being more irritable after not having slept well. As such, the idea that we are entirely culturally determined flies in the face of our own experience.</p><p>But the converse idea, that our biology dictates our behaviors is equally wrong. This is the <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/the-fallacy-of-biological-determinism"><u>fallacy of biological determinism</u></a>. Unlike other species, we have multiple mechanisms for transcending our biology. For instance, we have the capability of self reflection using language: I am irritable today because I didn’t sleep well – I can fix this by napping or by taking a deep breath. We also have the power of knowledge to modify our own biology. We take medication all the time to escape the determinism of biology – in the past minor infections killed people routinely, today we have antibiotics to treat these. As importantly, we use the power of knowledge to make biological differences less relevant (and in many cases downright irrelevant). Raw physical strength is less and less required in most jobs as humans control machines instead. Arguments of the type “x is human nature and hence society needs to be organized as y” should therefore be deeply suspect.</p><p>Instead of trying to win a debate on the direction of determinism we will only make progress once we acknowledge that humans exist inside a multiscale system in which different scales interact with each other and causality runs in both directions. Our biology impacts our culture and our culture impacts our biology. Both are dynamic and evolving. Technological progress makes possible new forms of interaction by expanding the space of the possible.</p><p>I contain multitudes. Walt Whitman’s famous poetic declaration applies to all of us. We have the capacity to be selfish but also to be altruistic. Different cultures will bring out more of one and less of the other. The real beauty now is that we have enough history and enough knowledge to be able to reason about the interplay. We have clear examples of the failure of attempts to enforce pervasive altruism (e.g. state communism), as well as of letting selfishness trump everything (e.g. late stage capitalism). The extremes may appear intellectually appealing as simpler but they produce dysfunctional trajectories.</p><p>I want to provide an important analogy from physics. How does a molecule of water (H2O) behave? We can’t answer this question based on the “nature” of the molecule alone. It has many different capabilities and which one of them is realized depends on whether it is part of a liquid, solid or gas. Conversely we cannot analyze and predict the transition of a material between phases without understanding what the material is made of. For instance, some molecules don’t allow for a liquid phase at ambient pressure and materials made of them turn straight from a solid into a gas when heated.</p><p>Multiscale analysis, as in the interaction between different scales, is central to both technological and moral progress. So far this modality has been severely underdeveloped because of the historical division of labor between different disciplines. For instance, the separation between biologists and political scientists has held back progress tremendously. A concrete example is our ongoing difficulty in reconciling the “selfish gene” theories of natural selection with the observation of group effects on the allocation of resources. Thankfully there is now work tackling this, such as a recent paper on “<a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://pubmed.ncbi.nlm.nih.gov/40065655/"><u>Natural selection at multiple scales</u></a>” (thanks to <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://x.com/erikphoel"><u>Erik Hoel</u></a> for pointing me to this).</p><p>In this regard I am highly optimistic that we are entering an era of great progress for two reasons. First, with more researchers working outside of traditional academia they can throw off the strictures of departmental boundaries. Second, artificial intelligences have access to all of human knowledge, far outstripping what any one human can keep in their mind. And these two factors interact: at least for now it is far easier for researchers outside of traditional academia to leverage AI capabilities (we are seeing this effect on display in math at the moment).</p><p>So my plea today is: let’s leave behind simplistic notions of unidirectional determinism and embrace multiscale analysis. As we dig in we will uncover that some systems are "bottom-heavy," others are "top-heavy," while the most interesting systems, such as human societies, will turn out to have many scales of function. This will unlock tremendous scientific, technological and moral progress.&nbsp;</p>]]></content:encoded>
            <author>continuations@newsletter.paragraph.com (Albert Wenger)</author>
            <category>pm</category>
            <category>multiscale</category>
            <category>progress</category>
            <category>human-nature</category>
            <enclosure url="https://img.paragraph.com/cdn-cgi/image/format=auto/https://storage.googleapis.com/papyrus_images/998863486d9a4bdf8547429efe23373fa08cae8c77c803df37936b0e4f28473c.jpg" length="0" type="image/jpg"/>
        </item>
        <item>
            <title><![CDATA[Universal Moral Core Principle 1: Implications]]></title>
            <link>https://continuations.com/universal-moral-core-principle-1-implications</link>
            <guid>EhRfrFSJttA9Qrlppgl4</guid>
            <pubDate>Mon, 10 Aug 2026 15:51:06 GMT</pubDate>
            <description><![CDATA[In last week's post I explained the first principle of the Universal Moral Core (UMC) in greater detail. Today I want to investigate some of its implications for how we should behave. As a reminder, earlier in the series, I suggested that the goal of philosophy should be to help us answer the following question: How should we choose our actions in light of our understanding of reality and the potential impact of our actions on this reality (which happens to include how we and others are feeli...]]></description>
            <content:encoded><![CDATA[<p>In last week's post I <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/universal-moral-core-principle-1"><u>explained the first principle</u></a> of the <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/a-proposal-for-a-universal-moral-core"><u>Universal Moral Core</u></a> (UMC) in greater detail. Today I want to investigate some of its implications for how we should behave.</p><p>As a reminder, earlier in the series, I suggested that the <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/philosophy-mondays-choice"><u>goal of philosophy </u></a>should be to help us answer the following question:</p><p><em>How should we choose our actions in light of our understanding of reality and the potential impact of our actions on this reality (which happens to include how we and others are feeling)?</em></p><p>So how does principle 1 help us do this? Well for each action we can ask ourselves if it is likely to help grow knowledge. One important part here is the "likely" -- we can never have certainty about the outcomes of our actions. There are too many unknowns and too much randomness in the world. This is why we need to apply <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/philosophy-mondays-judgment"><u>judgment</u></a>, which I introduced earlier in the series.</p><p>Take lying as an example. What does principle 1 tell us about it? The answer is: it depends. There can be no strict rules or calculus of consequences absolving us from exercising <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/philosophy-mondays-judgment"><u>judgment</u></a>. Different people will come to different conclusions, which is entirely acceptable as long as the principle can act as an overall guide post to making decisions.</p><p>Consider lying about the outcome of an experiment by falsifying the data. The principle suggests that this is bad and probably to be avoided. Falsified data pollutes knowledge, potentially for generations to come. Allocation of resources may be severely misguided as a result. The 2006 Alzheimer's paper in Nature perfectly illustrates this type of damage. The author had manipulated the experimental results to fabricate cleaner and more impactful data. The paper wasn’t retracted until 2024 and in the meantime a lot of research funding had been allocated towards chasing down this specific finding.</p><p>On the other hand, consider lying to an officer of a dictatorial regime to protect a scientist from persecution. The principle suggests that this is acceptable. Technically, given that I have defined knowledge as being externalized in a medium, a lie in a conversation doesn’t even enter knowledge (at least not directly unless someone records it). Even over email or text it stays quite confined between two parties. If that exchange were to be published it would still be seen as a statement in a specific context. Now what about if this scientist subsequently winds up developing a horrible virus that kills millions of people? Unless you had active knowledge of their plans to do so this cannot possibly enter the decision. The details of the future are unknowable. The scientist might instead be the one who develops the antiviral.</p><p>This is one concrete example of how the principle enables people to make judgments about choosing an action. It is not crucial that everyone arrives at the same judgment every time. Instead what matters is a direction, which leads me to the next point. The principle isn’t just about individual choice but it is also about systems which have a higher likelihood of growing knowledge.</p><p>Let’s consider censorship. We can easily see how this is bad when it suppresses the publication of criticism. Without the ability to criticize existing knowledge, our explanations can no longer be improved. Wrong or misleading knowledge will simply persist. As it turns out there are many subtle forms of censorship, such as the allocation of attention and resources to graduate students based on whether what they are working on is supportive or critical of the existing dominant theory (often created by their advisor or the head of the department). Then there is the pervasive self-censorship based on wanting the approval of others or more recently from fearing an online mob. The first principle suggests that these are all bad forms of censorship. Systems that support pervasive censorship are thus bad.</p><p>Does principle 1 categorically rule out all censorship? No. For example, censoring calls for violence against individuals or groups is in most cases compatible with this principle. Threats of violence are a key method of suppressing criticism. So censoring these types of threats will often support the growth of knowledge.</p><p>Now a big claim of the UMC is to apply, well, universally. Let’s consider an artificial super intelligence (ASI). We would want such an ASI to be deeply aligned with this principle, so that it can exercise judgment in situations such as the ones described above. An ASI that falsifies data at scale would deeply pollute knowledge. Given that it lacks many of the limitations that apply to humans, the scale of such pollution could be vast and take a long time to discover and unwind. An ASI lying to protect a specific human from prosecution again seems entirely acceptable. Similarly, ASI participating in mass censorship seems deeply problematic as it could easily freeze knowledge. Conversely, an ASI detecting and suppressing calls for violence appears beneficial.</p><p>What about different human societies? One requirement for the UMC was to “allow for the largest variety of cultures to exist.” So from the perspective of principle 1 it is not an issue if there are some societies that want to exercise extensive censorship, as long as this remains limited to their society. It will potentially result in a slow down in the growth of knowledge but will not inhibit it. Where we need to exercise great care though is if that society is trying to export its censorship widely so that it becomes dominant for all of humanity. Similarly, it is acceptable, albeit undesirable, if a society is worse at rooting out academic fraud, again as long as this doesn’t become endemic to all of humanity. So the principle is universal in the sense that these societies would likely be better off with less censorship and higher academic integrity but there is no need to compel them unless it becomes a systemic threat to all of human knowledge.</p><p>Similarly, we should not expect all ASIs to be aligned with this principle. Someone somewhere will likely create an ASI aimed at pervasive global censorship. What matters is that there are a sufficient number of ASIs aligned with this principle to help fight off any threats from the ones that are not. This is one of several reasons why <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/we-need-actually-open-ai-now-more-than-ever-or-why-leopold-aschenbrenner-is-dangerously-wrong">a plurality of ASIs is highly desirable over a single ASI</a>.</p><p><br></p><br><p><br></p>]]></content:encoded>
            <author>continuations@newsletter.paragraph.com (Albert Wenger)</author>
            <category>pm</category>
            <category>umc</category>
            <category>knowledge</category>
            <enclosure url="https://img.paragraph.com/cdn-cgi/image/format=auto/https://storage.googleapis.com/papyrus_images/16e5d05787efc4cf8d0723543e0fdf3c7e5ccadc17a67e8b154eda81ee6f8595.jpg" length="0" type="image/jpg"/>
        </item>
        <item>
            <title><![CDATA[The Cost of Capital in the AGI Age]]></title>
            <link>https://continuations.com/the-cost-of-capital-in-the-agi-age</link>
            <guid>dfSU8QeqFTWno3ebIag3</guid>
            <pubDate>Sun, 09 Aug 2026 17:17:48 GMT</pubDate>
            <description><![CDATA[A few years back we experienced the infamous vibecession. Kudos to Kyla Scanlon for this terrific term which captures a moment where the public feels bad about the economy at a moment where traditional economic indicators are not showing a recession. At the time there was a huge amount of commentary on where the “bad vibes” might be coming from. Lots of theories were advanced, but then, as is always the case, the news cycle moved on. Therefore an important paper published in early 2024 about ...]]></description>
            <content:encoded><![CDATA[<p>A few years back we experienced the infamous <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://en.wikipedia.org/wiki/Vibecession"><u>vibecession</u></a>. Kudos to <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://x.com/kylascan"><u>Kyla Scanlon</u></a> for this terrific term which captures a moment where the public feels bad about the economy at a moment where traditional economic indicators are not showing a recession. At the time there was a huge amount of commentary on where the “bad vibes” might be coming from. Lots of theories were advanced, but then, as is always the case, the news cycle moved on. Therefore an important <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.nber.org/system/files/working_papers/w32163/w32163.pdf"><u>paper</u></a> published in early 2024 about what was going on received relatively little attention. The paper is quite descriptively titled “<a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.nber.org/system/files/working_papers/w32163/w32163.pdf"><u>THE COST OF MONEY IS PART OF THE COST OF LIVING: NEW EVIDENCE ON THE CONSUMER SENTIMENT ANOMALY</u></a>” As it turns out one of the co-authors of the paper was Larry Summers – which may have harmed subsequently publicity for the paper.</p><p>The critical point being examined in the paper is that “[t]he cost of money is not currently included in traditional price indexes.” What does this mean? The numbers that the government and economists are tracking are what you pay if you are buying the product without borrowing. So consider a car that drops in price from $30,000 to $28,000. The car has just become 6.7% cheaper. Suppose though that you have to borrow to buy the car and the interest rate goes from say 7% to 10%. This could be due to a change in overall interest rates or because you personally go from being a prime borrower to being a subprime borrower. Here is what the change in the price of the car looks like for you over four years (1.10^3 <em> $28K) / (1.07^3 </em> $30K) = &nbsp; 1.464 <em> $27K / 1.331 </em> $30K = $40.99 / $39.32K = 1.0425. Instead of 6.7% cheaper, the car has become 4.25% more expensive for you!</p><p>Now when the authors add the cost of money in, what they find is that their “[...] alternative measures of inflation [...] include borrowing costs and can account for almost three quarters of the gap in US consumer sentiment in 2023.” This is a massive effect. It basically says that as a first approximation the vibecession is explained by the cost of borrowing! By the way, this exclusion was an intentional change in how the consumer price index is calculated made in 1983!</p><p>This insight is crucially important as we think about policies for the age of AGI. People who need to borrow to pay for cars, houses, etc. experience a fundamentally different economic reality from those who have the capital to make these purchases. Many people will face a two fold pain as AI becomes capable: there will be increased pressure on wages and employment while at the same time interest rates will go up. Why the latter? Because capital is becoming more productive.&nbsp;</p><p>In 2013 <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://x.com/PikettyWIL">Thomas Piketty</a> published <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/capital-in-the-21st-century-by-thomas-piketty-book-review"><em>Capital in the 21st Century</em></a>. The “capital” in the title refers primarily to financial capital (as distinct from physical capital as in the <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://worldaftercapital.org/"><u>title of my book</u></a>). Piketty traces what happened to wealth distribution over a long period of time. One of his core concerns is summarized by the inequality “r &gt; g” – the idea that financial wealth could be growing faster than the economy resulting in increased wealth concentration.</p><p>Now it has been debated whether this condition could ever hold for the economy as a whole over a prolonged period of time. Many in the “let AI rip” contingent believe that the economy will somehow adjust by itself so as to eventually make everyone better off. “Eventually” does a lot of work here, as history has shown repeated prolonged periods of where things got worse for large parts of the population. <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://x.com/DAcemogluMIT">Daron Acemoglu</a>’s book <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://continuations.com/power-and-progress-book-review"><em>Power and Progress</em></a> documents many examples of this. So what then are the relevant policies?</p><p>It is therefore urgent that we figure out how to address this or we will face the potential of a vibepression! This is why <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://x.com/gigidanziger_">Gigi</a> and I recently signed on to the <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.wemustactnow.ai/"><u>We Must Act Now statement</u></a>, and had previously signed on to the <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://aipledgeforhumanity.org/"><u>AI Pledge for Humanity</u></a>.</p><p>There are two policies that absolutely stand out. The first is competition. Only competitive markets turn productivity gains into price reductions. In markets with a lot of market power these result in increased profits (*) instead. “Profits” here carries an important asterisk because in the modern managerial economy these don’t necessarily accrue to shareholders, but often show up as excessive managerial compensation. Nevertheless it is essential to have competitive markets if we want AI productivity gains to result in pervasively lower prices. At present we are far from this across much of the economy.</p><p>The second policy is some form of basic income or negative income tax. This is essential for two reasons. First, in the absence of a floor we will wind up with insufficient automation as labor will be too cheap (other interventions have way more distortive side effects). Second, income is the basis for demand, which in turn is crucial for preventing an economic depression. Many of the jobs that will remain the purview of humans (qua their being human), such as hospitality and caring professions, cannot support themselves in the absence of paying demand. Essentially as Andy Stern put it in his book on Basic Income we should put a “floor” underneath everyone. This is radically more pro market and creates way more opportunities for adjustment than programs such as Section 8 housing and food stamps.</p><p>These two policies are crucial not just for the transition period but even matter in a full AGI scenario as you can see in this <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://albertwenger.me/agi_economy/"><u>general equilibrium model</u></a> (you can find the <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://github.com/albertwenger/agi_economy"><u>code on Github</u></a>).</p><p>Now <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://x.com/gigidanziger_"><u>Gigi</u></a> and I have done a lot more than sign on to pledges. Instead of waiting for governments to act, we have started a <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://eutopia.global/"><u>slew of initiatives</u></a> to pull forward a positive, high AI future into the present. Two of our initiatives deal directly with the cost of money. The first is our <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.hudsonup.org/"><u>HudsonUP Universal Basic Income Pilot</u></a>. We have been long time proponents of UBI, see Gigi <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://www.youtube.com/watch?v=HQqN_d0tzYg"><u>talking about it nearly a decade ago</u></a>. There is also <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://worldaftercapital.gitbook.io/worldaftercapital/part-four/economic"><u>an entire chapter about it in my book</u></a>. If you have access to a steady stream of financial capital, even a relatively small amount, then deflationary technology will make you better off.</p><p>The second are our <a target="_blank" rel="noopener noreferrer nofollow ugc" class="dont-break-out" href="https://eutopia.global/steward-ownership/"><u>steward ownership projects</u></a>. In these projects we buy and renovate buildings. We then make these buildings available to small businesses or residents at the carrying costs. This means the lease rates only have to cover taxes, insurance and maintenance. There is no current payment to us and since these are 100% equity financed there are no interest payments on a mortgage either. Furthermore, we cannot sell or mortgage the buildings without the consent of the lessees. Finally, we have agreed to share any capital appreciation 50:50 with the leaseholders. The net effect is substantially below market rate leases and a true sense of ownership through both decision making and upside participation. Steward ownership simulates in the here and now a world in which physical capital becomes super cheap to construct.</p><p>We encourage others who have access to capital today, to also commit some portion of their capital to similar projects. It is not enough to tell people that it will all be fine simply because AGI and robots will make everything cheap. We must show in the here and now what that world might look and feel like. This will get people excited about the policies that are necessary for a successful transition into the AGI age.</p><p><br><br><br></p><br><p><br><br></p>]]></content:encoded>
            <author>continuations@newsletter.paragraph.com (Albert Wenger)</author>
            <category>capital</category>
            <category>twac</category>
            <category>agi</category>
            <enclosure url="https://img.paragraph.com/cdn-cgi/image/format=auto/https://storage.googleapis.com/papyrus_images/721a43b8a430b47ea52c596bfac1014a566c40fe5a33076d36a46d1866f3b907.jpg" length="0" type="image/jpg"/>
        </item>
    </channel>
</rss>