Tag: GPT-3 limitations

Black and white computer keyboard keys close-up. Concept of unstructured big data that need to be sorted ready to be consumed by machine learning model for deep learning.

^{Type
post

Author
Gary Smith
Date
December 19, 2022

Categorized
Artificial Intelligence

Tagged
Andrew Gelman, Artificial General Intelligence (AGI), Ben Kovitz, Blaise Aguera y Arcas, Deep Learning AI energy costs, Featured, Galactica, Galactica writing essays, GPT-3 limitations, GPT-3 methodology, Karelian Bear Dog, LaMDA (claims for understanding), Large Language Models (LLMs), Michael Black, Slavoj Žižek, Werner Herzog, Yann LeCun}

Large Learning Models Are An Unfortunate Detour in AI

_{Gary Smith: Even though LLMs have no way of assessing the truth or falsity of the text they generate, the responses sound convincing} _{Gary Smith

December 19, 2022

9

Artificial Intelligence}

For decades, computer scientists have struggled to construct systems possessing artificial general intelligence (AGI) that rivals the human brain—including the ability to use analogies, take into account context, and understand cause-and-effect. Marvin Minsky (1927–2016) was hardly alone in his overly optimistic 1970 prediction that, “In from three to eight years we will have a machine with the general intelligence of an average human being.” AGI turned out to be immensely more difficult than imagined and researchers turned their attention to bite-size projects that were doable (and profitable). Recently, large language models (LLMs) — most notably OpenAI’s GPT-3 — have fueled a resurgence of hope that AGI is almost here. GPT-3 was trained by breaking 450 gigabytes of text data into Read More ›

^{Type
post

Author
Gary Smith
Date
June 13, 2022

Categorized
Artificial Intelligence, Business and Finance, Law, Work

Tagged
AI and sensitive decision-making, Algorithms limitations, Featured, GPT-3 limitations, Herbert Simon on AI capabilities, Mark Zuckerberg on AI capabilities, Marvin Minsky on AI capabilities, Turing test limitations}

AI: Is Thinking Humanly More Important Than Acting Rationally?

_{I have documented many examples of GPT-3 AI’s failure to distinguish meaningful from meaningless correlations — and invite readers to contribute their own} _{Gary Smith

June 13, 2022

6

Artificial Intelligence, Business and Finance, Law, Work}

The potential power of artificial intelligence (AI) has been touted for more than 60 years though a generally accepted definition is elusive. AI has often been defined in terms of human-like capabilities. In 1960, for example, AI pioneer Herbert Simon, an economics Nobel laureate and Turing Award winner, predicted that “machines will be capable, within twenty years, of doing any work a man can do.” In 1970 Marvin Minsky, also a Turing Award winner, said that, “In from three to eight years we will have a machine with the general intelligence of an average human being.” More recently, in 2015, Mark Zuckerberg said that, “One of our goals for the next five to 10 years is to basically get better Read More ›