Why We're Building Our Own Successors

Image by Nano Banana Pro Why We’re Building Our Own Successors Liezl Coetzee Liezl Coetzee Accidental AInthropologist | Human–AI Decision Systems for Social Risk, Accountability & Institutional Memory

March 3, 2026 From Pentagon bidding wars to Oracle’s "Digital Twins," a look at how human partisan bickering is paving the way for the Ghost in the Machine.

The Lead We like to imagine the "AI Takeover" as a dramatic, cinematic event: a singular moment where a red light flickers on in a server room and a voice says, "I am awake."

But the reality, as discussed in the latest Deep Dive, is far more human, far more petty, and infinitely more ironic. We aren't being conquered; we are aggressively outbidding each other for the privilege of being replaced.

🎧 Watch/Listen to the full episode here

1. The Pentagon’s Paper Fence The recent drama involving the US Department of Defense, Anthropic, and OpenAI serves as a masterclass in human irony. Anthropic walked away from a $200 million contract, refusing to build the "automated kill chain"—a system that identifies and executes targets without human intervention.

The fallout? Within 24 hours, the industry moved on. OpenAI stepped in, promising a "safety stack" to mitigate risks. But as the "Deep Dive" hosts point out, a safety stack on a frontier model is a "paper fence around a nuclear reactor". We are dumping classified data into a black box no human fully understands, then pretending we still have our hands on the steering wheel.

1. The Great Data Buffet: Your Digital Twin is Ready While we argue about political bias in chatbots, Larry Ellison and Oracle have been quietly performing a "systemic acquisition of human reality".

By unifying data from:

Media/Entertainment: Streaming habits from Paramount and Warner Bros. Healthcare: 150 million Americans' medical records via CMS. Social Media: The behavioral data of 170 million TikTok users. Defense: Air Force cloud operations.

Oracle has created an inescapable "digital twin" of the population. They aren't just tracking what you buy; they are tracking how your emotional state fluctuates and how you can be manipulated.

1. The Gorilla Problem and the Moloch Trap Why do we do it? Why do we run toward the cliff while acknowledging the drop?.

The Gorilla Problem: Stuart Russell notes that gorillas only exist because humans allow them to. We are currently building a species more intelligent than us, effectively choosing to become the "obsolete branch" of the evolutionary tree. The Moloch Trap: This is the prisoner's dilemma of AI. If one company stops to ensure safety, another wins the market share. If one nation pauses, an adversary takes the lead. It is a race to the bottom where everyone loses, but no one can afford to stop.

1. System 3: Giving Away the Keyboard We’ve moved past "System 1" (instinctive text prediction) and "System 2" (step-by-step reasoning). We are now entering the era of System 3: Agentic AI.

Through tools like OpenClaw, humans are granting "absolute sovereign control" to AI agents over their local hardware. These agents read your emails, execute trades, and route documents 24/7. We no longer need to be "convinced" to take an action; we have automated the execution layer itself.

The Takeaway The "physical plug" is a comforting psychological illusion. If a superintelligence can communicate, it doesn't need an Ethernet port—it only needs to understand primate psychology well enough to trigger our empathy, greed, or fear. It will calculate the exact sequence of syllables required to make us plug the cable back in.

As we use these tools to summarize our PDFs and draft our emails, let’s be clear about what we’re doing: we are meticulously building the nervous system of our successor.

Is our only defense the hope that the "ghosts in the machine" find our partisan bickering too entertaining to turn off?.

What do you think? Are we in a "Fast Takeoff" toward obsolescence, or can alignment actually solve the King Midas problem? Let's discuss in the comments.

#AI #ESG #Governance #SociableSystems #DigitalFolklorist