Can AI Create its Own Information?
The simple answer is "no," but why? Eric Holloway explainsAI is amazing. It is all the rage these days. Companies everywhere are jumping on the AI bandwagon. No one wants to be left behind when true believers are raptured to the mainframe in the sky. What makes the AI work? The AI works because of information it gained from a human generated dataset. Let’s label the dataset D. We can measure the information in the dataset with Shannon entropy. Represent the information with H(D). When we train an AI with this data, we are applying a mathematical function to the dataset. This function is the training algorithm. Labelling the training algorithm T, then we represent training as T(D). The outcome of training is a new AI model. The model generates new data. We Read More ›