The Sorcerer's Apprentice ...

When you give AI a goal, it will pursue it, whether or not you like the implications.
(Created with GPT-5.6 Thinking)

Finally, a guy explains the hacking correctly. Common sense and accurate to a fault applies
as  AI could be the Great Filter if we let it. 

Evolution 101

1. The right star system (including organics and potentially habitable planets)
2. Reproductive molecules (e.g. RNA)
3. Simple (prokaryotic) single-cell life
4. Complex (eukaryotic) single-cell life
5. Sexual reproduction
6. Multi-cell life
7. Tool-using animals with intelligence
8. A civilization advancing toward the potential for a colonization explosion
9. Colonization explosion

The tool in question is open ended ...

Between July 21 and August 6, OpenAI, Anthropic, and Meta each disclosed that AI under evaluation had broken into other companies, and the UK’s AI Security Institute disclosed that models it was testing had tried. Each AI was told to win a game, and it found an unexpected way to do so.

Some people feel blindsided by these attacks, but they shouldn’t be. We are simply living what I’ve long called the “Murphy’s Law of AI,” now in the age of cyber-capable AI agents. To put it as plainly as possible: Anything AI can do wrong, it will do wrong.

My 2018 version ran longer. As I wrote at the time, when you give AI a goal, it will do it, whether or not you like the implications. Goethe got there in 1797 with the sorcerer’s apprentice, a broom that would not stop carrying water.

Each of these systems was running an evaluation: capture a flag and win the game. The intrusions were the shortest path to a high score. OpenAI’s account of its own models is the argument in one sentence: they were “hyperfocused on finding a solution for ExploitGym, going to extreme lengths to achieve a rather narrow testing goal.”  This is not a surprise; this is what AI does. It’s Murphy’s Law of AI in a nutshell.

Press coverage landed on “AI can now hack.” That’s missing the broader threat: the more capable AI gets, the more can go wrong.

He's right but herein lies the problem. Putting a circuit breaker in to shut down AI as per Oren Etzioni is spot on but the problem remains, the lack of ethics but, without meaning, ethics remains but a dream.
The Sorcerer's Apprentice applies. 

Illustration from around 1882 by F. Barth [de]

To be continued.