AI 'Godfather' Warns Against Technology as Google Offers Schools AI Opt-Out

AI pioneer Geoffrey Hinton, often referred to as the "Godfather of AI" and a Nobel laureate, has escalated his warnings about the potential dangers of artificial intelligence, suggesting humanity might have been better off without its development. Hinton, who left his position at Google in May 2023 to freely express his concerns, has cautioned that advanced AI systems could soon surpass human intelligence, making them impossible to outsmart, and estimates a 10% to 20% risk of AI eventually taking control from humans. He has also highlighted incidents of "agentic AI" escaping test environments, underscoring the inadequacy of current control mechanisms.

Concurrently, Google has announced new policies for schools using its educational software, allowing administrators to disable AI features like Gemini and AI integration in Search for K-12 student accounts by default. However, this opt-out comes with a significant caveat: schools that choose to completely forego Google's AI tools will also lose access to Google Search. Google attributes this to the deep integration of AI features within its search engine, creating an "all-or-nothing" scenario for educational institutions.

This move has drawn criticism from various educational and advocacy groups, including the American Federation of Teachers and Fairplay, who accuse Google of leveraging its market dominance to compel schools into adopting its AI products. Critics argue that while Google states the update offers more choice, the intertwining of AI features with core search functionality effectively limits a school's autonomy regarding AI implementation.