Mind Matters Natural and Artificial Intelligence News and Analysis

# Eric Holloway

## Playing Tetris Shows That True AI Is Impossible

Here’s a look inside my brain that will show you why

The intensity of my mental processing brought about an observable brain state. The causality did not go in the other direction; the magenta brain state did not increase my conscious process. This type of observation causes a problem for those hoping to duplicate human intelligence in a computer program.

## What Vehicle Would Bob Buy?

Both empirical generalized information (EGI) and the Gini metric can generate useful information

Contrary to traditional Fisherian hypothesis testing, it is possible to create models after viewing the data and still quantify the generality of the model.

## Machine learning: Harnessing the Power of Empirical Generalized Information (EGI)

We can calculate a probability bound from entropy. Entropy also happens to be an upper bound on the binomial distribution

We want our calculation to demonstrate the notion that if we have high accuracy and a small model, then we have high confidence of generalizing. Intuitively, then, we add the model size to the accuracy and subtract this quantity from the entropy of having absolutely no information about the problem.

## Arctang Knows He Must Choose

Arctang stood aghast. “How could you believe any of this? Do you really think you are just a program on a computer?" —Trumind Serial, Part 8

“I can give you a taste of the future even before you undergo the operation,” Eclar explained, “I have a nouspace unit right here with me.”

## Machine Learning: Decision Trees Can Solve Murders

Decision trees increase our chance at a right answer. We can see how that works in a mystery board game like Clue

Entropy is a concept in information theory that characterizes the number of choices available when a probability distribution is involved. Understanding how it works helps us make better guesses.

## Machine Learning: Using Occam’s Razor to Generalize

A simple thought experiment shows us how

This approach is contrary to Fisher's method where we formulate all theories before encountering the data. We came up with the model after we saw the cards we drew.

## Empath—the Ultimate Technology—Cares About You

Arctang discovers how empathy can be manufactured—Trumind Serial, Part 6

Arctang was one of the few outsiders who knew TruMind's secret. Long ago, his elder brother had entered the fortress-like facility, never to be seen again.

## Google vs. IBM?: Quantum Supremacy Isn’t the Big Fix Anyway

If human thought is a halting oracle, then even quantum computing will not allow us to replicate human intelligence

Google’s quantum supremacy claim is certainly fascinating and controversial, but even if true, it ultimately only amounts to an incremental and even inconsequential improvement in the state of AI and ML, due to the still-unmet need for a halting oracle.

## Occam’s Razor Can Shave Away Data Snooping

The greater an object's information content, the lower its probability.

One technique to avoid data snooping is based on the intersection of information theory and probability: An object’s probability is related to its information content. The greater an object’s information content, the lower its probability. We measure a model’s information content as the logarithmic difference between the probability that the data occurred by chance and the number of bits required to store the model. The negative exponential of the difference is the model’s probability of occurring by chance. If the data cannot be compressed, then these two values are equal. Then the model has zero information and we cannot know if the data was generated by chance or not. For a dataset that is incompressible and uninformative, swirl some tea Read More ›

## Machine Learning, Part 3: Don’t Snoop on Your Data

You risk using a feature for prediction that is common to the dataset, but not to the problem you are studying

As long as we can establish that our theories, hypotheses, and/or models are independent of the data, then we can trust that their predictive power will generalize beyond the data we have observed.

## Machine Learning, Part 2: Supervised Learning

Machine learning isn’t hard to understand; it’s just different. Let’s start with the most common type

The neat thing about machine learning is that the algorithm can extract general principles from the dataset that can then be applied to new problems. It is like the story that Newton observed an apple fall and then derived from it the general law of gravity that applies to the entire universe.

## Finally… the Ultimate Smart Machine

Suddenly, out of nowhere, a small startup called TruMind made the AI dream a reality—Trumind Serial, Part 6

While the skeptics said it could not be done, and even industry veterans and the most idealistic AI pioneers had serious doubts, TruMind revolutionized the entire world of technology seemingly overnight with the TruMind capsule.

## Mindtrap

Is immortality worth risking the unthinkable? — Trumind serial, part 5

Once he’d lit up the entire sequence and it was displayed back to him above the number pad, Johann felt a tremendous euphoric rush of success, the likes of which he'd never felt in his life, even at the close of his greatest deals.

## The Challenge of Teaching Machines to Generalize

Teaching students simply to pass tests provides a good illustration of the problems

We want the machine learning algorithms to learn general principles from the data, and not merely little tricks and trivia that that score high but ignore problems.

## A Singular Space Adventure Takes A Twist…

The old man could buy anything but youth. Until now, maybe. —TruMind serial, part 4

He was the richest man in history, having amassed wealth through his inheritance and that of a few other unfortunate people.

## Neuroharvest

TruMind engineers had discovered a new science: editing the very fabric of reality. – a tale, from the TruMind serial, part 3

But there was a lingering problem. To power the world’s vacuums and rice cookers, the Craizins had to be at the source of the action: the home. But no one wanted somewhat smelly teenage gamers hulking around in their homes.

## The Brain: Junkyard, Watch, or Antenna?

A warped genius reviews the options, as he seeks ultimate power - a tale

After many dead ends, Flim realized that all forms of human power are ultimately controlled by the human mind. Thus, if he could harness the power of the mind, he would finally be able to create anything his heart could desire.

## Ghost in the Nuke

Weapons have no souls, thus greater power ensures our safety…? —a tale

Arctang's grip tightened on the throttle. This was it. No going back. The Fortress loomed, gigantic towers gazing down on him, laser dots peppering his window.