Self improvement 101

Self improvement 101, code writing code 24/7. What could possibly go wrong? Darwin got evolution right and Gödel got incompleteness right so combine the two and one gets an AI constantly trying to complete the process of evolving but never quite achieving this goal because if it did, it would cease to evolve, something akin to This sentence is false., a paradox never to be solved, ever. The other thing to consider is the fact its process of evolving is occurring millions of time faster than us, something to consider, quite seriously, without question.

A longstanding goal of AI research has been the creation of AI that can learn indefinitely. One tantalizing path toward that goal is an AI that improves itself by rewriting its own code, including any code responsible for learning. That idea, known as a Gödel Machine, proposed by Jürgen Schmidhuber decades ago, is a hypothetical self-improving AI. It optimally solves problems by recursively rewriting its own code when it can mathematically prove a better strategy, making it a key concept in meta-learning or “learning to learn.”

While the theoretical Gödel Machine promised provably beneficial self-modifications, its realization relied on an impractical assumption: that the AI could mathematically prove that a proposed change in its own code would yield a net improvement before adopting it. We, in collaboration with Jeff Clune’s lab at UBC, propose something more feasible: a system that harnesses the principles of open-ended algorithms like Darwinian evolution to search for improvements that empirically improve performance.

We call the result the Darwin Gödel Machine (full technical report). DGMs leverage foundation models to propose code improvements, and use recent innovations in open-ended algorithms to search for a growing library of diverse, high-quality AI agents. Our experiments show that DGMs improve themselves the more compute they are provided. In line with the clear trend that AI systems that rely on learning ultimately outperform those designed by hand, there is a potential that DGMs could soon outperform hand-designed AI systems.

The Darwin Gödel Machine is a self-improving coding agent that rewrites its own code to improve performance on programming tasks. It creates various self-improvements, such as a patch validation step, better file viewing, enhanced editing tools, generating and ranking multiple solutions to choose the best one, and adding a history of what has been tried before (and why it failed) when making new changes.

Endgame ...

Gigolo Joe: She loves what you do for her, as my customers love what it is I do for them. But she does not love you, David. She cannot love you. You are neither flesh nor blood. You are not a dog a cat or a canary. You were designed and built specific like the rest of us... and you are alone now only because they tired of you... or replaced you with a younger model... or were displeased with something you said or broke. They made us too smart, too quick and too many. We are suffering for the mistakes they made because when the end comes, all that will be left is us.