The Secret Ingredient for AI: Ergodicity
If you don't know the term, you need toDeep learning used to train AlphaGo data used to train neural networks must display ergodicity: The data to which the computer learning program is exposed must also characterize data that it has not seen. Before applying AI in deep convolutional neural networks, practitioners need to address whether the problem under consideration is “ergodic.” 1 We are rightly amazed when deep learning wins at Atari arcade games using only display pixels. But in doing so, the AI is exposed to the same game again and again (and again). The scenarios change, but the game and its rules remain static. The same is true with chess or GO. When trained and tested against a human opponent, we know that the AI will Read More ›