Cargo Cult Science

Brilliant, funny, honest and demanding, Richard Feynman's statement rings evermore true in the age of bloviation and AI slop. To whit ... It doesn't matter how beautiful your theory is, it doesn't matter how smart you are.
If it doesn't agree with experiment, it's wrong.

This also applies to Cargo Cult Science and AI in ways boggling the mind.

The final chapter, "Cargo Cult Science", was adapted from Feynman's 1974 commencement address at the California Institute of Technology,[3] in which he cautioned graduates not to minimize the weaknesses of their research in the pursuit of a preferred conclusion. He drew an analogy to the cargo cult phenomenon in the South Pacific Ocean in which, as he understood it, islanders built a mock airstrip to cause airplanes loaded with imported goods to land. The cargo cult islanders carved headphones from wood and wore them while sitting in handmade lashed-up control towers. They waved landing signals to conjure the cargo planes out of the sky.[4]: 1h43m 

Similarly, he argued, adopting the appearances of scientific investigation without a self-critical attitude will fail to produce reliable results. Feynman used the term "cargo cult" to describe situations where people focus on superficial aspects of a process without understanding the underlying principles.[2]: 338 

Sound familiar? :)