Mind Matters Natural and Artificial Intelligence News and Analysis

TagKolmogorov complexity

real-php-code-developing-screen-programing-workflow-abstract-algorithm-concept-lines-of-php-code-visible-under-magnifying-lens-stockpack-adobe-stock.jpg
Real Php code developing screen. Programing workflow abstract algorithm concept. Lines of Php code visible under magnifying lens.

How did Ray Solomonoff Kickstart Algorithmic Information Theory?

He started off the long pursuit of the shortest effective string of information that describes an object

In last week’s podcast,, “The Chaitin Interview II: Defining Randomness,” Walter Bradley Center director Robert J. Marks interviewed mathematician and computer scientist Gregory Chaitin on how best to describe true randomness but also on what he recalls of Ray Solomonoff (1926–2009), described in his obit as the “Founding Father of algorithmic information theory.” https://episodes.castos.com/mindmatters/Mind-Matters-125-Gregory-Chaitin.mp3 This portion begins at 10:30 min. A partial transcript, Show Notes, and Additional Resources follow. Gregory Chaitin (pictured): Ray Solomonoff was interested in prediction but I was more interested in looking at a given string of bits and asking, does it have structure or not, and the incompleteness results regarding this question. For example, most strings of bits have no structure, according to this definition. They…

spiral-profile-stockpack-adobe-stock.jpg
Spiral Profile

Toward a Serious Scientific Theory of Consciousness

Quantum physics arises from the fact that when we do not observe a particle, it can be in two different places at once, such that it interacts with itself

Consciousness is the ultimate hard problem of philosophy of science. As of today, there is absolutely no scientific solution to the problem. The nature of consciousness seems ineffable: first person experience appears to be a completely different category of existence than objective externaldescription. This dilemma has led philosophers such as Daniel Dennett to use the ultimate solution: deny the problem exists. Unfortunately, that solution never worked for me at school. The objective reality of bad grades is quite hard to deny. Yet, we need not resort to Daniel Dennett’s ultimate solution. There are concrete things we can say about consciousness if we use the “many worlds” interpretation of quantum physics and the computer science concept of Kolmogorov complexity. Quantum physics…

gray-rock-formation-under-white-clouds-during-daytime-stockpack-unsplash.jpg
gray rock formation under white clouds during daytime

Robert J. Marks on Specified Complexity and Meaningful Information (Part II)

What is specified complexity? What makes some information more meaningful than other information? How does information theory affect artificial intelligence? Dr. Michael Egnor discusses information theory, artificial intelligence, and mimetic contagion with Dr. Robert J. Marks. Show Notes 00:37 | Mount Rushmore vs. Mount Fuji 05:11 | Specified complexity 10:38 | How does a statue of Abraham Lincoln differ from…

question-signs-stockpack-adobe-stock.jpg
Question Signs

Information Is the Currency of Life. But What IS It?

How do we understand information in a universe that resists resolution into one single, simple system?

At first, “What is information?” seems like a question with a simple answer. Stuff we need to know. Then, if we think about it, it dissolves into paradoxes. A storage medium—a backup drive, maybe—that contains vital information weighs exactly the same as one that contains nothing, gibberish, or dangerously outdated information. There is no way we can know without engaging intelligently with the content. That content is measured in bits and bytes, not kilograms and joules—which means that it is hard to relate to other quantities in our universe. In this week’s podcast, “Robert J. Marks on information and AI, Part 1.” neurosurgeon Michael Egnor interviews Walter Bradley Center director and computer engineering prof Robert J. Marks on how we…

toothpick-stockpack-adobe-stock.jpg
toothpick

They Say This Is An Information Economy. So What Is Information?

How, exactly, is an article in the news different from a random string of letters and punctuation marks?

We know information when we see it. An article contains information. A photograph contains information. The thoughts in our mind contain information. So does a computer program and so do our genomes. Yet other things we see around us clearly do not contain information. A handful of toothpicks dropped on the ground does not. Nor do the swirling tea leaves in a cup. Neither does a pair of tossed dice nor a sequence of 100 coin flips. But mere disorder is not the clue. An intricate snowflake does not contain information either. Can we state the difference between the article and the scattered toothpicks precisely? That’s tricky. Both Claude Shannon and Andrey Kolmogorov came up with information metrics. But the…

Quantum computer system. Internet connection. Net system. Modern big data. Magic code. .Techno pattern. Intersect grid. Symmetry lines. Energy blocks. Kaleidoscopic shape. AI. Sci-fi

Google vs. IBM?: Quantum Supremacy Isn’t the Big Fix Anyway

If human thought is a halting oracle, then even quantum computing will not allow us to replicate human intelligence

Google’s quantum supremacy claim is certainly fascinating and controversial, but even if true, it ultimately only amounts to an incremental and even inconsequential improvement in the state of AI and ML, due to the still-unmet need for a halting oracle.

Read More ›
Programming code abstract technology background of software deve

The Flawed Logic behind “Thinking” Computers, Part I

A program that is intelligent must do more than reproduce human behavior

If an algorithm that reproduces human behavior requires more storage space than exists in the universe, it is a practical impossibility that also demonstrates the logical impossibility of artificial intelligence.

Read More ›