Mind Matters Natural and Artificial Intelligence News and Analysis

TagLLMs

illustration-of-future-education-classroom-with-robotic-tech-teacher-ai-stockpack-adobe-stock
illustration of future education classroom with robotic tech teacher . AI

If ChatGPT Had Children, Would They Be Geniuses or Blubbering Idiots?

It would seem that when AI begets more AI, the result is nonsense.

Can today’s artificial intelligence systems be used to train superior artificial intelligence systems of tomorrow? Can AI write better AI that writes better AI leading to a potentially god-like general artificial intelligence? In a recent insightful paper written by collaborators from Oxford, Cambridge and other prestigious institutions, the verdict is in for large language models (LLMs) like ChatGPT. Repeatedly using the output of one LLM to train another results in what the authors call model collapse. If only the words from the original LLM #0 are used to train LLM #1 and only the output of LLM #1 is used to train LLM #2, and so on, the AI eventually suffers model collapse and becomes a blubbering idiot. The emergence of superintelligence by Read More ›

adult-student-reading-a-book-in-the-college-library-young-standing-male-wearing-glasses-with-bookshelves-on-background-stockpack-adobe-stock
Adult student reading a book in the college library. Young standing male wearing glasses with bookshelves on background.

In the Wake of AI Books, What Does Authorship Mean?

While of course it's easy to use AI to generate text, the quality and storytelling are lacking.

We all know there are a lot of books out there. Perusing your local used bookstore and you may find hundreds of old romance paperbacks, and somehow most of them managed (at least at one point) to make the New York Times bestsellers’ list. It’s estimated that 500,000 to 1 million books are published each year, and that’s excluding self-published material. The publishing market has become saturated, with the average book selling less than 200 copies. From the advent of the printing press centuries ago to e-books and online publishing, humans alone have managed to generate a mountain of words. But suppose one person could “generate” not just a few books in a lifetime, but hundreds every year? According to Read More ›

chalk graph
businessman hand writing a business graph on a touch screen inte

A Graph Can Tell a Story—Sometimes It’s an Illusion

Mistakes, chicanery, and "chartjunk" can undermine the usefulness of graphs

A picture is said to be worth a thousand words. A graph can be worth a thousand numbers. Graphs are, as Edward Tufte titled his wonderful book, the “visual display of quantitative information.” Graphs should assist our understanding of the data we are using. Graphs can help us identify tendencies, patterns, trends, and relationships. They should display data accurately and encourage viewers to think about the data rather than admire the artwork. Unfortunately, graphs are sometimes marred (intentionally or unintentionally) by a variety of misleading techniques or by what Tufte calls “chartjunk” that obscures rather than illuminates. I have described elsewhere many ways in which mistakes, chicanery, and chartjunk can undermine the usefulness of graphs. I recently saw a novel Read More ›

students-making-notes-stockpack-adobe-stock
Students making notes

Learning to Communicate

Why writing skills are so important, especially in today's artificial world

Educators have been shaken by fears that students will use ChatGTP and other large language models (LLMs) to answer questions and write essays. LLMs are indeed astonishing good at finding facts and generating coherent essays — although the alleged facts are sometimes false and the essays are sometimes tedious BS supported by fake references. I am more optimistic than most. I am hopeful that LLMs will be a catalyst for a widespread discussion of our educational goals. What might students learn in schools that will be useful long after they graduate? There are many worthy goals, but critical thinking and communication skills should be high on any list. I’ve written elsewhere about how critical thinking abilities are important for students Read More ›

a-holographic-head-representing-modern-technology-ai-floats-in-a-classroom-setting-created-with-generative-ai-stockpack-adobe-stock
A holographic head representing modern technology / ai floats in a classroom setting. Created with generative ai

Text Generators, Education, and Critical Thinking: an Update

The fundamental problem remains that, not knowing what words mean, AI has no critical thinking abilities

This past October, I wrote that educational testing was being shaken by the astonishing ability of GPT-3 and other large language models (LLMs) to answer test questions and write articulate essays. I argued that, while LLMs might mimic human conversation, they do not know what words mean. They consequently excel at rote memorization and BS conversation but struggle mightily with assignments that are intended to help students develop their critical thinking abilities, such as Lacking any understanding of semantics, LLMs can do none of this. To illustrate, I asked GPT-3 two questions from a midterm examination I had recently given in an introductory statistics class. Both questions tested students critical thinking skills and GPT-3 bombed both questions. I was hopeful Read More ›