Mind Matters Natural and Artificial Intelligence News and Analysis

TagGoodhart's Law

lying-businessman-holding-fingers-crossed-behind-his-back-stockpack-adobe-stock
Lying businessman holding fingers crossed behind his back

Gaming the System: The Flaws in Peer Review

Peer review is well-intentioned, but flawed in many ways

Last time, we examined how scientific publication has ceased to be a good measure of scientific accomplishment because it has now become a target, following Goodhart’s Law. In today’s post, we will continue that examination by turning to the peer review system, and how that system is being gamed by unscrupulous publishers and researchers alike. In theory, the peer review process is intended to ensure that research papers do not get published unless impartial experts in the field deem them worthy of publication. Peer review is well-intentioned, but flawed in many ways. First, the best researchers are incredibly busy and naturally more inclined to do their own research than to review someone else’s work. Thus, peer review is often cursory or…

abstract-binary-code-science-computing-center-stockpack-adobe-stock.jpg
abstract binary code science computing center

Can AI Really Evolve into Superintelligence All by Itself?

We can’t just turn a big computer over to evolution and go away and hope for great things

At Science earlier this year it was claimed that Darwinian evolution alone can make computers much smarter. As a result, researchers hoped to “discover something really fundamental that will take a long time for humans to figure out”: Artificial intelligence (AI) is evolving—literally. Researchers have created software that borrows concepts from Darwinian evolution, including “survival of the fittest,” to build AI programs that improve generation after generation without human input. The program replicated decades of AI research in a matter of days, and its designers think that one day, it could discover new approaches to AI. Edd Gent, “Artificial intelligence is evolving all by itself” at Science (April 30, 2020) How does that work? The program discovers algorithms using a…