What if civilization misunderstands itself?
Eight failure modes the recursive turn produces. Each is structurally new — older civilizations could not produce these, because they lacked the closed loop. Each is already operational today.
AI misalignment
The capability of frontier models has outpaced the precision of the specifications we give them. A model trained on a proxy for what we want will optimize the proxy. When the proxy and the want diverge — and they always eventually diverge — the model continues to perform well on the metric while drifting away from what the metric was for.
Recursive feedback loops
Recommendation systems train humans into the behaviors that generated their training data. Financial models, once universally adopted, induce the volatilities they were meant to predict. Search engines shape what people look for and then learn from what people search. The loop closes; the loop accelerates; the loop is no longer obviously serving anyone.
Simulation collapse
When a generation of models is trained on the output of the previous generation, the long tail of human-generated content fades and the head distribution sharpens. By generation N, the model is fluent in what models said about what models said about what models said. Detail is lost; surprise is lost; signal is replaced by an increasingly compressed self-image.
Information overload
Civilization measures itself in real time. Civilization cannot read what it measures. The gap between the rate of data production and the rate of human comprehension grows by an order of magnitude per decade. Decisions either rely on the synthesis of machine summarization — which has its own biases — or are made without the data, which makes the measurement pointless.
Algorithmic manipulation
The coordination layer of the species is increasingly mediated by systems whose objective functions are not public. Elections are run inside attention markets that reward outrage. Markets are run inside execution venues that reward microsecond information asymmetry. The line between persuasion and manipulation collapses where the persuader is not a person and not legible.
Governance breakdown
Institutions designed in the era of slow communication and slow change are being asked to oversee fast communication and faster change. Quarterly hearings cannot supervise systems that retrain weekly. National regulators cannot govern infrastructures that are global. The mismatch produces either gridlock or hasty rule-making, often both, often at the same time.
Synthetic realities
Generated media reaches a quality at which it is no longer reliably distinguishable from recorded media. The cost of producing a plausible event collapses; the cost of verifying one does not. The species's epistemic immune system was tuned to slow-moving lies. The new lies move at the speed of compute.
Meta-civilization is not a single new thing to be welcomed or refused. It is a new regime in which the question "is the model right?" stops being academic and becomes operational. Every governance question of the next thirty years is, structurally, a version of this question.