Jump to content

Statement on AI risk of extinction

Edit links
From Wikipedia, the free encyclopedia

On May 30, 2023, hundreds of artificial intelligence experts and other notable figures signed the following short Statement on AI Risk:[1][2][3]

Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war.

At release time, the signatories included over 100 professors of AI including the two most-cited computer scientists and Turing laureates Geoffrey Hinton and Yoshua Bengio, as well as the scientific and executive leaders of several major AI companies, and experts in pandemics, climate, nuclear disarmament, philosophy, social sciences, and other fields.[1][2][4] Media coverage has emphasized the signatures from several tech leaders;[2] this was followed by concerns in other newspapers that the statement could be motivated by public relations or regulatory capture.[5] The statement was released shortly after an open letter calling for a pause on AI experiments.

The statement is hosted on the website of the AI research and advocacy non-profit Center for AI Safety. It was released with an accompanying text which states that it is still difficult to speak up about extreme risks of AI and that the statement aims to overcome this obstacle.[1] The center's CEO Dan Hendrycks stated that "systemic bias, misinformation, malicious use, cyberattacks, and weaponization" are all examples of "important and urgent risks from AI... not just the risk of extinction" and added, "[s]ocieties can manage multiple risks at once; it's not 'either/or' but 'yes/and.'"[6][4]

Among the well-known signatories are: Sam Altman, Bill Gates, Peter Singer, Daniel Dennett, Sam Harris, Grimes, Stuart J. Russell, Jaan Tallinn, Vitalik Buterin, David Chalmers, Ray Kurzweil, Max Tegmark, Lex Fridman, Martin Rees, Demis Hassabis, Dawn Song, Ted Lieu, Ilya Sutskever, Martin Hellman, Bill McKibben, Angela Kane, Audrey Tang, David Silver, Andrew Barto, Mira Murati, Pattie Maes, Eric Horvitz, Peter Norvig, Joseph Sifakis, Erik Brynjolfsson, Ian Goodfellow, Baburam Bhattarai, Kersti Kaljulaid, Rusty Schweickart, Nicholas Fairfax, David Haussler, Peter Railton, Bart Selman, Dustin Moskovitz, Scott Aaronson, Bruce Schneier, Martha Minow, Andrew Revkin, Rob Pike, Jacob Tsimerman, Ramy Youssef, James Pennebaker and Ronald C. Arkin.[7]

Reception

[edit]

The Prime Minister of the United Kingdom, Rishi Sunak, retweeted the statement and wrote, "The government is looking very carefully at this."[8] When asked about the statement, the White House Press Secretary, Karine Jean-Pierre, commented that AI "is one of the most powerful technologies that we see currently in our time. But in order to seize the opportunities it presents, we must first mitigate its risks."[9]

Skeptics of the letter point out that AI has failed to reach certain milestones, such as predictions around self-driving cars.[4] Skeptics also argue that signatories of the letter were continuing funding of AI research.[3] Companies would benefit from public perception that AI algorithms were far more advanced than currently possible.[3] Skeptics, including from Human Rights Watch, have argued that scientists should focus on the known risks of AI instead of distracting with speculative future risks.[10][3] Timnit Gebru has criticized elevating the risk of AI agency, especially by the "same people who have poured billions of dollars into these companies."[10] Émile P. Torres and Gebru both argue against the statement, suggesting it may be motivated by TESCREAL ideologies.[11]

See also

[edit]

References

[edit]
  1. ^ a b c "Statement on AI Risk". Center for AI Safety. May 30, 2023.
  2. ^ a b c Roose, Kevin (2023-05-30). "A.I. Poses 'Risk of Extinction,' Industry Leaders Warn". The New York Times. ISSN 0362-4331. Retrieved 2023-05-30.
  3. ^ a b c d Gregg, Aaron; Lima-Strong, Cristiano; Vynck, Gerrit De (2023-05-31). "AI poses 'risk of extinction' on par with nukes, tech leaders say". Washington Post. ISSN 0190-8286. Retrieved 2024-07-03.
  4. ^ a b c Vincent, James (2023-05-30). "Top AI researchers and CEOs warn against 'risk of extinction' in 22-word statement". The Verge. Retrieved 2024-07-03.
  5. ^ Wong, Matteo (2023-06-02). "AI Doomerism Is a Decoy". The Atlantic. Retrieved 2023-12-26.
  6. ^ Lomas, Natasha (2023-05-30). "OpenAI's Altman and other AI giants back warning of advanced AI as 'extinction' risk". TechCrunch. Retrieved 2023-05-30.
  7. ^ "Statement on AI Risk | CAIS". www.safe.ai. Retrieved 2024-03-18.
  8. ^ "Artificial intelligence warning over human extinction – all you need to know". The Independent. 2023-05-31. Retrieved 2023-06-03.
  9. ^ "President Biden warns artificial intelligence could 'overtake human thinking'". USA TODAY. Retrieved 2023-06-03.
  10. ^ a b Ryan-Mosley, Tate (12 June 2023). "It's time to talk about the real AI risks". MIT Technology Review. Retrieved 2024-07-03.
  11. ^ Torres, Émile P. (2023-06-11). "AI and the threat of "human extinction": What are the tech-bros worried about? It's not you and me". Salon. Retrieved 2024-07-03.
Retrieved from "https://en.wikipedia.org/w/index.php?title=Statement_on_AI_risk_of_extinction&oldid=1250966801"