Anthropic urges AI labs to pause, warns humans risk losing control

Key points

• It warned that rapid advances in technology could soon allow AI systems to improve themselves faster than society can control the risks.
• Anthropic is proposing that the world’s top artificial intelligence companies come up with a coordinated way to pause development of advanced AI systems, warning that the technology is improving so quickly that there’s a risk humans would lose control.
• The company behind the Claude chatbot said in a blog post on Thursday that, as cutting-edge AI gets increasingly faster at carrying out tasks, “it would be good for the world to have the option to slow or temporarily pause” its development.
• Anthropic said its internal research institute plans to explore the issue in collaboration with others and “take actions” to help build the systems for a credible slowdown or pause, without being more specific.
• Anthropic rival OpenAI argued for a different approach in a report published on Wednesday,...