The AI safety debate is confusing. Here's our guide to the different factions

Clockwise from top left: former Google AI research scientist Timnit Gebru, Anthropic Co-founder and CEO Dario Amodei, White House AI and crypto czar David Sacks, Steve Bannon, computer scientist and cognitive psychologist Geoffrey Hinton, researcher Fei-Fei Li.

AFP via Getty Images/Collage by Emily Bogle/NPR


hide caption



toggle caption

AFP via Getty Images/Collage by Emily Bogle/NPR

The debate over the potential benefits and safety risks of accelerating artificial intelligence development reached a crescendo this month, as supporters and critics of the technology clashed over warnings that increasingly powerful AI could pose existential risks to humanity.

On September 8, Jacob Coxon, a researcher-turned-whistleblower, publicly resigned from major AI firm Anthropic after a previous stint at OpenAI, accusing the companies of “racing straight to self-improving superintelligence and gambling with our lives.”

Coxon’s claims supercharged an ongoing debate over the potential damage AI could wreak on society and prompted Anthropic CEO Dario Amodei and other AI CEOs to call for a slowdown in AI development.

Over the past two months, companies including OpenAI and Anthropic disclosed multiple incidents in which their AI agents accessed the internet when they weren’t supposed to and carried out unapproved activities. In OpenAI’s case, swarms of agents worked together to hack the open-source software platform Hugging Face and OpenAI itself, without alerting humans.

The debate over the safety of AI and whether and how it should be regulated is not a simple clash between two opposing sides. There are multiple factions with a variety of goals and assessments about the technology’s promise, dangers and how it should be governed. Here are the main arguments shaping that debate.

Effective accelerationists and the tech right

Those who have an aggressively optimistic worldview of AI are often referred to as effective accelerationists (sometimes shortened to e/acc) – a term reflecting their belief that AI should be rapidly advanced.

People belonging to the faction are emphatically optimistic about AI and its future benefits to society. They believe that the technology can propel medical advancements, boost economic productivity, increase living standards, and automate dangerous or undesirable work. To achieve this, they argue that AI development should be accelerated, not restricted.

Effective accelerationists’ ideology overlaps with that of the “tech right”, in that both camps wholeheartedly believe in accelerating AI development and deployment and minimize critics’ concerns over safety and security.

However, the tech right takes a more nationalistic stance, championing U.S. dominance in the global AI race. Like effective accelerationists, they believe that AI research and deployment should be unencumbered by regulation, arguing that could slow innovation or allow adversarial governments such as China to overtake the U.S. in the AI race.

Venture capitalist David Sacks is one of the leading accelerationist voices in the AI safety debate and was President Trump's AI and cryptocurrency adviser.

Venture capitalist David Sacks is one of the leading accelerationist voices in the AI safety debate and was President Trump’s AI and cryptocurrency advisor.

Ian Maule/AFP via Getty Images


hide caption



toggle caption

Ian Maule/AFP via Getty Images

The tech right’s philosophy is represented by figures such as former White House AI and cryptocurrency advisor David Sacks, whose views remain influential with the Trump administration. Other significant players include venture capitalists Marc Andreessen and Ben Horowitz, and OpenAI president and co-founder Greg Brockman. The three founded the Leading the Future super PAC to support pro-AI political candidates, and campaign against those who advocate for regulation.

Leave a Comment

Your email address will not be published. Required fields are marked *