Anthropic co-founder actually wants AI to slow down

Key points· Video

• AI models are rapidly improving – so fast that they may soon be able to develop themselves without human involvement.
• That’s why Anthropic is warning the AI industry: It needs to build a “brake pedal,” or companies risk losing control of their creations.
• AI systems that can advance themselves, known as “full recursive self-improvement,” could have the potential for great good for science and health care, they also pose great risks for humanity, according to a blog post written by Marina Favaro, leader of The Anthropic Institute, and Jack Clark, a co-founder of Anthropic.
• 0:00 What does it mean for AI to improve itself?
• 2:11 What is the risk of self-improving AI?