The promise and peril of artificial general intelligence (AGI)
Artificial general intelligence presents a dual-edged future where unprecedented prosperity clashes with the potential loss of livelihoods and democratic norms. While systems capable of performing any human cognitive task could dramatically increase global living standards, they also threaten to sharply reduce demand for human labor. This transformation could fuel unemployment, social unrest, and conflict unless the benefits and ownership of these technologies are broadly shared. Sam Altman, CEO of OpenAI, has highlighted this tension in a blog post updated in 2025, acknowledging that navigating massive risks is essential to empowering humanity. He recognizes that while AGI offers incredible new capabilities, it carries the potential for drastic accidents and societal disruptions. This philosophical skepticism aligns with broader concerns that unquestioning faith in science can become a form of dogma. In a 2024 paper, Kaushik Basu and Jörgen Weibull applied game theory to show how scientific discoveries can create prisoner’s dilemma scenarios where rational individual behavior leads to worse collective outcomes. The rise of AGI could trigger such a knowledge curse, requiring prudent preventive measures rather than reliance on the private sector alone. Addressing these challenges demands resource redistribution and concerted international cooperation. A critical consequence of widespread AGI adoption is the decline in labor demand, potentially rendering work defined by compensation obsolete. Although individuals may enjoy increased leisure, billions dependent on labor income face the prospect of deprivation. Consequently, Altman advocates for a universal basic income to guarantee a minimum standard of living. Beyond income security, there is a risk that concentrated control over AGI systems could pave the way for global authoritarianism. Preventing this outcome requires limiting extreme concentrations of wealth and power through mechanisms like a universal basic share. Such a system would restrict how much wealth any individual or group can hold, protecting both the poor and the affluent from becoming part of a tomorrow's underclass controlled by a tiny elite.
发布时间： June 20, 2026 at 06:29 AM
News Article
内容
Artificial general intelligence presents a dual-edged future where unprecedented prosperity clashes with the potential loss of livelihoods and democratic norms. While systems capable of performing any human cognitive task could dramatically increase global living standards, they also threaten to sharply reduce demand for human labor. This transformation could fuel unemployment, social unrest, and conflict unless the benefits and ownership of these technologies are broadly shared.
Sam Altman, CEO of OpenAI, has highlighted this tension in a blog post updated in 2025, acknowledging that navigating massive risks is essential to empowering humanity. He recognizes that while AGI offers incredible new capabilities, it carries the potential for drastic accidents and societal disruptions. This philosophical skepticism aligns with broader concerns that unquestioning faith in science can become a form of dogma.
In a 2024 paper, Kaushik Basu and Jörgen Weibull applied game theory to show how scientific discoveries can create prisoner’s dilemma scenarios where rational individual behavior leads to worse collective outcomes. The rise of AGI could trigger such a knowledge curse, requiring prudent preventive measures rather than reliance on the private sector alone. Addressing these challenges demands resource redistribution and concerted international cooperation.
A critical consequence of widespread AGI adoption is the decline in labor demand, potentially rendering work defined by compensation obsolete. Although individuals may enjoy increased leisure, billions dependent on labor income face the prospect of deprivation. Consequently, Altman advocates for a universal basic income to guarantee a minimum standard of living.
Beyond income security, there is a risk that concentrated control over AGI systems could pave the way for global authoritarianism. Preventing this outcome requires limiting extreme concentrations of wealth and power through mechanisms like a universal basic share. Such a system would restrict how much wealth any individual or group can hold, protecting both the poor and the affluent from becoming part of a tomorrow's underclass controlled by a tiny elite.