Mind Matters Natural and Artificial Intelligence News and Analysis

TagSCIgen

large-language-model-ai-machine-learning-concept-brain-business-stockpack-adobe-stock
large language model AI machine learning concept brain business

A Sloppy “AI Scientist” Could Make the Science Crisis Much Worse

A research team claims to have developed the AI Scientist that “generates novel research ideas, writes code, executes experiments ...” Really?
It continues to astonish us how easily people can be persuaded that LLMs (chatbots) can do our thinking for us Read More ›
stack-of-papers-isolated-on-white-background-stockpack-adobe-stock
Stack of papers isolated on white background

A Vulnerable System: Fake Papers and Imaginary Scientists

Publication counts and citation indexes are too noisy and too easily manipulated to be reliable

In the last two posts, we examined how scientific publication has ceased to be a good measure of scientific accomplishment, and how the peer review system is being gamed by unscrupulous publishers and researchers alike. Now, we will continue the discussion on the undermining of scientific publication using two examples: SCIgen and citation counts. SCIgen In 2005 three MIT graduate computer science students created a prank program they called SCIgen for using randomly selected words to generate bogus computer-science papers complete with realistic graphs of random numbers. Their goal was “maximum amusement rather than coherence,” and also to demonstrate that some academic conferences will accept almost anything. They submitted a hoax paper titled, “Rooter: A Methodology for the Typical Unification of Access Points and Redundancy,” Read More ›