Tag: Model collapse

^{Type
post

News
Date
May 9, 2025

Categorized
Creativity, Large Language Models (LLMs)

Tagged
Copyright infringement, Eric Holloway, Featured, Isaac Newton, Model collapse, Pat Flynn, Robert J. Marks}

AI Large Language Models: Real Intelligence or Creative Thievery?

_{AI lacks originality because it cannot originate. It can only borrow. This is as true of impressive chatbots (large language models or LLMS) as of all other types} _{News
May 9, 2025

5

Creativity, Large Language Models (LLMs)}

The real danger lies not in what AI can do, but in forgetting what only humans can do. Read More ›

national crossword puzzle day december 21

^{Type
post

Eric Holloway
Date
March 3, 2025

Categorized
Large Language Models (LLMs)

Tagged
Andrey Markov (1856–1922), Claude Shannon (1916–2001), Markov process, Model collapse, Redundancy in language}

How the Father of Information Theory Invented Modern AI

_{In 1948 Claude Shannon used Andrey Markov’s 1906 process to formulate an appproach that enabled the development of chatbots (large language models)} _{Eric Holloway
March 3, 2025

5

Large Language Models (LLMs)}

The Markov process also explains why an LLM degrades when it is trained on its own output — its drift toward the most probable state ends in rubbish. Read More ›

^{Type
post

News
Date
August 28, 2024

Categorized
Creativity, Large Language Models (LLMs)

Tagged
Maggie Harrison Dupré, Model collapse}

AI Going MAD? The Model Collapse Problem Gets More Attention Now

_{The problem is that the AI can't generate anything new on its own and the old stuff, endlessly recycled at high speeds, begins to erode} _{News
August 28, 2024

3

Creativity, Large Language Models (LLMs)}

If human involvement is minimized, this hard limit will probably come up time and again. Computation is not creativity. Read More ›

hacker cat working job profession illustration generative ai

^{Type
post

Denyse O'Leary
Date
June 3, 2024

Categorized
Artificial Intelligence, Arts & Culture, Business and Finance, Creativity

Tagged
Copyright and generative AI, copyright law, Jonathan Bartlett (on AI and copyright), Kate Crawford, Model collapse, Robert J. Marks, Robert J. Marks on AI and copyright, Stable Diffusion}

Generative AI Is Creating a Copyright Crisis for Artists

_{How does an artist assert copyright when her image was only one of many used to create a new image? How does she make a living if she can’t?} _{Denyse O'Leary
June 3, 2024

4

Artificial Intelligence, Arts & Culture, Business and Finance, Creativity}

AI companies could be required to record images’ origin and compensate copyright holders. But as Robert J. Marks notes, end users might then have to pay. Read More ›

Evil robot head with glowing red eyes in data center, Ai generated image

^{Type
post

Eric Holloway
Date
January 25, 2024

Categorized
Artificial Intelligence, Ethics

Tagged
Model collapse}

Can AI Really Start Doing Evil Stuff All By Itself?

_{We need to first talk to the man in the mirror before we go around blaming transistor circuit boards for what’s wrong in the world} _{Eric Holloway
January 25, 2024

5

Artificial Intelligence, Ethics}

Far from being independent superintellects, AIs — without human input — are subject to Model Collapse, where they start reprocessing information into nonsense. Read More ›

An artificial intelligence robot writer creating generative AI writing

^{Type
post

News
Date
December 7, 2023

Categorized
Artificial Intelligence, Arts & Culture, Creativity

Tagged
chatbots, Eric Holloway, Hollywood Writers' Strike 2023, Model collapse, Predictive text, Robert J. Marks}

Can AI Write Screenplays for Films You’d Want to See?

_{That issue was the heart of the Hollywood writers’ strike. How was it resolved? Or WAS it resolved?} _{News
December 7, 2023

5

Artificial Intelligence, Arts & Culture, Creativity}

AI can replace screenwriters only if you are content to see the same-old same-old every day forever. That’s true no matter who owns the technology. Read More ›

^{Type
post

Casey Luskin
Date
November 9, 2023

Categorized
Artificial Intelligence

Tagged
AI, Artificial Intelligence, ChatGPT, COSM 2023, Model collapse, William Dembski}

Will Digital Inbreeding Be the End of AI?

_{Without the creative input of humans, AI is doomed to deteriorate.} _{Casey Luskin
November 9, 2023

5

Artificial Intelligence}

AI training on itself needs fresh creative material on which to train or algorithms will feed off themselves in recursive cycles and degenerate into nonsense. Read More ›

Uroboros, snake coiled in a ring, biting its tail. Engraving sketch scratch board imitation sepia.

^{Type
post

Denyse O'Leary
Date
November 3, 2023

Categorized
Artificial Intelligence, Creativity

Tagged
Bard, Common sense and AI, Darren Orf, Data poisoning, Model collapse, Victor Tangermann}

Model Collapse: AI Chatbots Are Eating Their Own Tails

_{The problem is fundamental to how they operate. Without new human input, their output starts to decay} _{Denyse O'Leary
November 3, 2023

7

Artificial Intelligence, Creativity}

Meanwhile, organizations that laid off writers and editors to save money are finding that they can’t just program creativity or common sense into machines. Read More ›