Mind Matters Natural and Artificial Intelligence News and Analysis

CategoryInformation Theory

composite-image-of-digital-illustration-of-pixelated-3d-woman-stockpack-adobe-stock.jpg
Composite image of digital illustration of pixelated 3d woman

At the Movies: Can AI Restore Blurred Images?

Working with pixels, we can do remarkable things—as long as we are not asking for magic

It’s an exciting scene in crime investigation movies. A critical image, like the one on the left below, is blurred by pixelization. The detective commands the technician, “Sharpen it!” and the technician pushes a key on a computer keyboard. The key activates an algorithm and, magically, the deblurred image on the right appears. That can’t be done in real life. An image cannot be sharpened using only the information in the image itself. This is proven by a mathy theorem called the data processing inequality. 1 The mutual information between an image and a corrupted blurred image cannot be increased by further processing. Period. That’s why the title of a recent news article from Duke University is misleading: “Artificial intelligence…

group-of-urban-runners-running-on-the-street-in-new-york-city-conceptual-series-about-sport-and-fitness-stockpack-adobe-stock.jpg
Group of urban runners running on the street in New york city, conceptual series about sport and fitness

Why Information Theory Is Like a Good Run

Information theory can help us understand a wide range of fields besides computers

Information theory is a deep field that is responsible for our modern internet and satellite TV. The field was pioneered by Claude Shannon to measure our ability to communicate meaning. But besides powering the information revolution, information theory is also very widely applicable elsewhere. Once you understand the basic intuition, you can see applications popping up all over the place. To prove the point, I’ll show how we can apply information theory to gain insight in the very low tech world of running. I’ve been running off and on for many years and I’ve noticed that information theory describes a good run. First of all, what is a good run? A good run is when your body feels as if…

coronavirus-market-crash-and-financial-crisis-stockpack-adobe-stock.jpeg
Coronavirus market crash and financial crisis

COVID-19: When 900 Bytes Shut Down the World

A great physicist warned us, information precedes matter and energy: Bit before it

The COVID-19 virus contains about as much information as a sticker in WhatsApp. Walter Bradley Center director Robert J. Marks and Dr. Daniel Andrés Díaz-Pachón  explore a dreadful truth:  “Human biology is so finely tuned that less than a kilobyte of information can stop the world.”

Read More ›