OpenAI Launches 'Preparedness' Initiative to Tackle AI-Related Risks and Mitigate Potential Threats
Summary:
OpenAI is launching an initiative named "Preparedness" to evaluate and mitigate broad-range risks associated with AI. The initiative will focus on potential AI threats including chemical, biological, radiological, and nuclear threats, individual persuasion, cybersecurity, and autonomous replication. Led by Aleksander Madry, the team will investigate the dangers of misuse of frontier AI systems. OpenAI has also launched an AI Preparedness Challenge for catastrophic misuse prevention, with $25,000 in API credits to be awarded for top submissions.
OpenAI, the company responsible for the development of AI technology like ChatGPT, is launching a project targeted at evaluating various potential perils associated with AI. Revealed on October 25, OpenAI is now structuring a unique team whose main focus will be to study, predict, and mitigate potential overwhelming hazards that could arise from the use of AI technology. This team, named "Preparedness", will be paying close attention to potential AI risks including chemical, biological, radiological, and nuclear threats, individual persuasion, cybersecurity, and spontaneous replication and adaptations.
The team, guided by Aleksander Madry, is tasked with understanding critical questions such as the level of danger an advanced AI system can pose when improperly used or if it, in the event of theft, could be deployed by harmful elements. "Frontier AI models," OpenAI shared, "have the potential to be beneficial to global humanity." Equally, they maintained that, these AI models could also pose "increasingly severe risks."
Expounding on the company's views, OpenAI stated: "We acknowledge and give serious consideration to all forms of safety risks associated with AI, from today's systems to the far extremes of superintelligence… To ensure the safety of highly-capable AI systems, we are refining our approach to dealing with catastrophic risk preparedness."
In addition to creating the new division, OpenAI is launching a challenge targeted at preventing catastrophic misuse of AI, promising $25,000 in API credits to the top 10 best submissions. The firm also announced it is on the lookout for talents from diverse technical backgrounds to become part of the Preparedness team.
OpenAI had earlier hinted at establishing a team focused on tackling potential AI hazards in July 2023. Traditionally, the potential dangers associated with artificial intelligence are often pointed out, triggering concerns that these AI systems could someday surpass human intelligence. Notwithstanding these fears, companies like OpenAI have actively pursued new AI technologies development, inadvertently raising more suspicion and anxiety.
In a comparable development, the Center for AI Safety, a nonprofit organization, in May 2023, published an open letter emphasizing AI risk. The center believes the risks that AI poses should be addressed seriously on a global scale, alongside other societal-scale risks, such as pandemics and nuclear warfare.
Published At
10/27/2023 10:03:56 AM
Disclaimer: Algoine does not endorse any content or product on this page. Readers should conduct their own research before taking any actions related to the asset, company, or any information in this article and assume full responsibility for their decisions. This article should not be considered as investment advice. Our news is prepared with AI support.
Do you suspect this content may be misleading, incomplete, or inappropriate in any way, requiring modification or removal?
We appreciate your report.