Former OpenAI Workers Issue Stark Warning: AI Poses Risk of Human Extinction

By Madz Dizon

Jun 05, 2024 03:48 AM EDT

Former OpenAI Workers Issue Stark Warning: AI Poses Risk of Human Extinction
OpenAI has launched two new product offerings: the GPT Store and the ChatGPT Team, the company said on Wednesday.
(Photo : KIRILL KUDRYAVTSEV/AFP via Getty Images)

Earlier this week, a letter was released by a collective of individuals who have previously worked at OpenAI and Google DeepMind. 

The letter urges AI companies to adopt a set of principles that would enable employees to voice their concerns regarding AI risks without facing any negative consequences.

Ex-OpenAI Workers Demand Accountability in AI Advancements

A group of 13 individuals, many of whom are former employees of companies such as OpenAI, Anthropic, and Google's DeepMind, have come together to express their concerns, Independent reported. 

They believe that it is crucial for leading AI researchers to have safeguards in place that allow them to freely voice their criticisms of new advancements and actively involve the public and policymakers in shaping the future of AI innovation.

The letter highlights concerns about the lack of effective oversight for companies developing powerful AI technologies, including artificial general intelligence (AGI), which is a theoretical AI system that rivals or surpasses human intelligence.

It suggests that these companies may have strong financial incentives to evade oversight from their employees and the general public.

READ NEXT: Meta's Election Tools Blocked Over Privacy Concerns Ahead of European Parliament Vote

OpenAI CEO Responds to Allegations

The group urges AI companies to embrace four essential principles: refraining from imposing agreements that stifle criticism regarding risk-related concerns, establishing a confidential channel for employees to voice their concerns, fostering a culture that encourages open criticism, and refraining from retaliating against employees who publicly disclose confidential risk-related information when other avenues have been exhausted.

According to Ars Technica, OpenAI CEO Sam Altman addressed the allegations by clarifying that the company has never taken back vested equity and has no intention of doing so if employees choose not to sign the separation agreement or non-disparagement clause.

However, despite the changes made by OpenAI, critics were still not satisfied. OpenAI quickly reversed its position on the matter and publicly announced that it would eliminate the non-disparagement clause and equity clawback provisions from its separation agreements. 

The company acknowledged that these terms were inappropriate and went against its commitment to transparency and accountability. The current open letter was made possible due to the move from OpenAI.

READ MORE: 2025 Social Security COLA: Potentially the Largest Increase in Years

© 2024 VCPOST, All rights reserved. Do not reproduce without permission.

Join the Conversation

Real Time Analytics