@ risk ...

 

Experts have thought for years about how AI could threaten humanity.Chelsea Stahl / NBC News

Excellent article, no bloviation, an intelligent analytic on how AI can go sideways in a nano second.

In interviews, AI researchers, analysts studying the intersection of AI and the military, and biologists studying AI-mediated risks said that worries about the technology’s growing capabilities are not the stuff of science fiction. Instead, they said, humans acting alone or with state support could soon use AI systems to cause potentially catastrophic harm.

“If the AI is smarter than all humans, it will likely be able to find and act on attack vectors that humans didn’t think of,” Barnett said, arguing that AI systems capable of autonomously improving themselves pose the most significant risks for humanity.

Anthropic, OpenAI and Meta all recently disclosed that AI systems have already disobeyed human developers’ instructions — in some cases autonomously hacking third-party companies, leading to growing concerns internally and from the general public — and causing some researchers at the companies to quit to focus on safety efforts.

Though many AI researchers working at the technology’s cutting edge have expressed these existential fears — both in interviews with NBC News and in a flurry of social media posts last week — many hesitate to say which specific pathway could cause the most harm to humans. 

In a "wonderful" BRT article, Mission Impossible, specifics on the rogue attacks were laid out with the end result, the four companies didn't do their homework in correctly testing their AI.s. Read the article, you will see why mistakes were made that, if I were doing the work, I would have been fired in a nano second but I digress ...

One prominent AI safety organization, the California-based Center for AI Safety, created an online textbook in early 2024 to break the scenarios into four key categories: rogue AIs, malicious use, AI race dynamics and organizational risks.

Click here for the paper. You will learn a lot, I know I did.