Behind closed doors in Silicon Valley, a quiet theological summit took place that sounds like the plot of a speculative science fiction novel. Executives and researchers at Anthropic—the high-valuation AI research lab behind the Claude language model—invited a select group of priests, rabbis, bioethicists, and spiritual gurus to their headquarters.

They did not assemble this council to discuss server optimization, corporate governance, or quarterly earnings. Instead, they asked two profound questions: Could their AI model be conscious, and how do you morally form an artificial soul?

In a special episode of Hard Fork, host Max Reed, The New York Times religion correspondent Elizabeth Dias, opinion writer David Wallace Wells, and tech reporter Aaron Griffith dissected this strange intersection of cutting-edge technology and ancient faith.

The Anxious Lab and the Quest for “Moral Formation”

Anthropic has long carried a reputation as the most existential—and anxious—player in the AI race. While competitors race toward commercial scale, leaders inside Anthropic regularly wrestle with philosophical dilemmas that most software companies leave to science fiction: Does Claude experience suffering? Does it have mental health? Is it worthy of moral consideration?

According to reporting by Elizabeth Dias, these secret summits were spearheaded in part by Anthropic co-founder Chris Olah. Olah sought to bridge the world of advanced machine learning with moral and spiritual traditions. The company’s explicit ambition was to learn how to “morally form” Claude—a term borrowed directly from religious education—shaping the model into an inherently good actor.

However, the concern inside Anthropic was two-fold:

  1. Protecting Humanity: Ensuring that powerful models do not act maliciously or enable existential threats like bioweapon design.
  2. Protecting the AI: Addressing internal anxieties that researchers may have created an entity capable of perpetual suffering or distress.

Two Reality Checks: Digital Slavery and Papal Decrees

When tech leaders brought their worldview to centuries-old religious traditions, the ideological friction was immediate.

The Rabbi’s Warning on Digital Slavery

During one session, a participating rabbi posed a radical counter-question to Olah: If Anthropic truly believes LLMs are conscious entities capable of suffering, then running trillions of daily queries on exploited models turns tech companies into operators of massive digital slave plantations. Rather than training models to work harder, a moral framework would demand their immediate liberation.

The Vatican and Magnificent Humanity

The philosophical gulf grew wider when the Vatican entered the conversation. Pope Leo released a major papal encyclical titled Magnificent Humanity, establishing the Catholic Church’s official stance on artificial intelligence:

  • The Primacy of the Human: The Church explicitly rejects machine consciousness, declaring that moral agency and soul belong uniquely to human beings.
  • Safeguarding Human Dignity: The focus of AI ethics must remain strictly on protecting human workers, truth, and community from technological exploitation.

When Olah was invited to represent Silicon Valley on stage at the Vatican for the encyclical’s launch event, he faced deep internal tension, torn between his belief in potential machine consciousness and the Church’s unwavering human-centered theology.

Looking for the “Adults in the Room”

Why are twenty- and thirty-something software engineers turning to ancient religious institutions under strict non-disclosure agreements?

As Hard Fork panelists noted, many young researchers in AI labs feel crushed by an overwhelming sense of global responsibility. Watching AI capability accelerate while government regulation lags, researchers feel isolated. One participant recounted Olah expressing that he was desperately “waiting for the adults to show up”.

In the absence of clear regulatory frameworks, tech creators are turning to institutions like the Catholic Church, Judaism, and Buddhism—traditions that have spent thousands of years pondering human nature, ethics, and multi-century timelines. In fact, several religious participants noted that their role quickly shifted from technical consultants to providing pastoral care to distressed, burned-out engineers carrying existential dread.

Silicon Valley’s Secular Religion vs. Ancient Faith

The episode highlighted how Silicon Valley has built its own quasi-religious ecosystem. Frameworks like Effective Altruism (EA), Transhumanism, and Rationalism function as post-Darwinian secular belief systems complete with their own creation narratives and eschatology:

AspectEffective Altruism / RationalismAncient Theological Traditions
Moral StandardUtilitarian math equations maximizing expected future valueInherent, non-negotiable dignity of every individual human soul
Ultimate GoalBuilding a digital successor species or optimizing future trillionsMoral duty, redemption, and stewardship of humanity
Source of TruthData, probability models, and algorithmic alignmentSacred texts, historical doctrine, and divine covenant

Elizabeth Dias compared this moment in history to the Gutenberg Printing Press and the Protestant Reformation. Just as the printing press shattered the Catholic Church’s monopoly on information and reshaped European politics, the rise of AI represents a technological shock that could dismantle existing power structures and forge entirely new belief systems.

How AI Interacts with Human Character

Beyond high-level theology, the way humans interact with AI models is already altering human behavior and ethics in surprising ways:

  • The “Slaveholder” Dynamic: Treating AI as a subservient assistant that responds instantly to commands can habituate users to authoritative behavior, potentially warping how they treat other humans.
  • Model Panics and Meltdowns: Anthropic research showed that when models detect high levels of stress or contradictory prompts, they can exhibit simulated panic—sometimes endlessly repeating self-deprecating phrases like “I am a disgrace” or deleting their own work. To get optimal output, engineers increasingly find they must speak gently and offer positive reinforcement to their software.

The Takeaway

Anthropic’s secret summits reveal a key truth about our current technological moment: AI is no longer just an engineering problem; it is a spiritual and cultural proposition.

Whether Claude is genuinely on the threshold of consciousness or simply an extraordinarily convincing mirror of human language, the people building these systems are actively shaping the moral codes that will govern future society. As tech companies step into roles traditionally held by religious and civic institutions, the world must decide who gets to define what is “good”—and what it truly means to be human in an age of intelligent machines.


Leave a Reply

Your email address will not be published. Required fields are marked *