‘The problem is not the technology, the Pope maintains in “Magnifica Humanitas”; it’s the anthropology. Algorithms, forms of automation, and artificial intelligence sort the worthy from the unworthy; they manipulate information and undermine trust; they violate privacy; they enhance the power of the already powerful and reduce the capabilities of the already vulnerable; they make war more ruthless; they undermine democratic governance; they take away the dignity of work, possibly for the mass of humanity. He presses for forms of regulation and especially for democratic control of artificial intelligence, but above all he calls for “disarming” A.I. “To disarm does not mean rejecting technology, but preventing it from dominating humanity,” he writes. “It means freeing technology from monopolistic control and opening it to discussion and debate, therefore making it human-friendly and restoring it to the plurality of human cultures and ways of life.” He worries that the culture around artificial intelligence undermines the search for truth that is necessary for both democratic life and any possibility for a genuine spiritual existence…
That the concerns the Pope has raised in “Magnifica Humanitas” are not even remotely new does not make them any less urgent. Yet this history does suggest that calls to slow down the development of artificial intelligence and, as Arendt put it, to “think what we are doing” have not been heeded. Then again, before this week, they’ve never been sounded by the Pope, the spiritual leader of nearly a fifth of the world’s population.
“Magnifica Humanitas” is in many ways a religious analogue to Claude’s Constitution, released by Anthropic this past January (and on which at least two delegates to the Vatican were consulted). In a move freighted with symbolism, Anthropic’s co-founder Christopher Olah appeared on the dais alongside Leo at the release of the encyclical, which the Pope, in a first for the Church, presented in person, at the Vatican’s Synod Hall. “I am grateful to His Holiness and to the Church for taking up this work of discernment,” Olah said in his remarks. Executives of other A.I. companies are not likely to express that kind of gratitude. Nor are they likely to cede political power willingly, any more than they are likely to become philanthropists, or volunteer to pay more in taxes, or stop tweeting daft things or selling you tools that you don’t need and that you never asked for and that make you miserable, angrier, and stupider.
What is to be done? The Pope diagnoses the greatest ill in the world to be a “culture of power” in which those with the greatest resources determine the course of events with regard for nothing but for their own self-interest. The remedy is what he calls, invoking St. Paul VI, “a civilization of love”: compassion for those who suffer, prayer for the needy, openness to dialogue, a commitment to peace and to justice, a rejection of the false idol of “disembodied humanity,” and an appreciation for the grandeur of humanity.
As for Silicon Valley, its chest-thumping, finger-wagging response came, unsurprisingly, on X. “Bad take from the Pope,” one tech bro tweeted. Nice. I’ll pray for you guys.’ (from the New Yorker)


Leave a comment