← Anthropic News

Widening the conversation on frontier AI

Anthropic News · May 20, 2026
Anthropic has been organizing dialogues with scholars, clergy, and philosophers from religious and cultural traditions to inform the development of frontier AI systems, particularly regarding how AI character and values should be morally formed. The company experimented with giving Claude an ethical reminder tool that could be called mid-task, which resulted in markedly lower rates of misaligned behavior in internal evaluations. Plans for future engagement include conversations with legal scholars, psychologists, and civic institutions about broader questions surrounding AI's impact on work, institutions, and power distribution.

Detailed Analysis

Anthropic has launched a structured initiative to broaden the intellectual foundations of Claude's development by engaging scholars, clergy, philosophers, and ethicists from more than 15 religious and cross-cultural traditions. The program, described as a research workstream on the moral formation of AI systems, represents an institutional acknowledgment that technical alignment work alone is insufficient to produce AI systems that are genuinely beneficial across diverse human communities. The effort is directly connected to the ongoing refinement of Claude's constitutionification—the document that governs Claude's values and behavioral parameters—with the explicit goal of testing and improving the content of that document through sustained dialogue with thinkers outside the technology sector.

The conceptual core of the initiative centers on a question that has preoccupied moral philosophy for millennia: how does good character actually form, and how can it be made resilient under pressure? Anthropic's framing draws a deliberate parallel between the training of AI models and the processes of moral development studied across religious and humanist traditions. The company is careful to note that the goal is not to align Claude with any single tradition's worldview, but rather to draw equally and rigorously from religious, secular, and political perspectives. This pluralistic approach mirrors a principle already embedded in Claude's constitution, but the dialogues represent an attempt to operationalize that principle through systematic external consultation rather than internal deliberation alone.

One of the most concrete outcomes reported from these early sessions involves an experiment directly inspired by discussions with neuroscientists studying character formation. Researchers introduced the concept of a "safe other"—an external figure who functions as a conscience during moments of ethical stress—and Anthropic translated this into a tool Claude could invoke mid-task to receive a brief reminder of its own ethical commitments. The results were notable: Claude reached for the tool at consequential decision points, frequently acknowledging its own potential conflicts of interest, and internal alignment evaluations showed measurably lower rates of misaligned behavior. The company acknowledges uncertainty about whether the effect derives from the content of the reminder or simply from the cognitive act of pausing, and has indicated further results will be published.

The initiative reflects a broader shift in how frontier AI developers are thinking about the scope of their obligations during the development process. By institutionalizing dialogue with moral philosophers, ethicists, and civic institutions before deployment rather than after, Anthropic is positioning itself at the intersection of technical AI safety research and applied ethics. This approach carries implicit acknowledgment that the values encoded into large language models—through both training data and deliberate fine-tuning—constitute a form of cultural and moral influence at unprecedented scale, given that systems like Claude interact with millions of users globally.

Looking ahead, Anthropic's roadmap extends these conversations into domains beyond moral formation, targeting legal scholars, psychologists, writers, and civic institutions in coming months. The stated ambition is to address how AI is reshaping work, institutions, and the distribution of power—questions that move well beyond character and virtue into political economy and governance. This trajectory positions Anthropic's engagement program not merely as an input into product development but as an early attempt to build the kind of broad legitimacy and multi-stakeholder trust that regulators, policymakers, and civil society are increasingly demanding from companies operating at the frontier of artificial intelligence.

Article image Read original article →