Gary Smith

Smartphone screen with smart home technologies on a blue backdrop. Internet of things isometric conceptual image. Digital Residence utilizing a mobile phone's fingerprint to get access to IOT systems

^{Type
post

Author
Gary Smith
Date
June 12, 2023

Categorized
Artificial Intelligence

Tagged
AI, Alan Turing, ChatGPT, data, Elon Musk, Gary Smith, GPT-3, Large Language Models (LLMs), Meta, Monty Hall Problem, Northeastern University, OpenAI, Sam Altman, Turing award, Yann LeCun}

The LLM Deep Fake—Follow the Money

_{Hype sells. Just look at what's happening with AI} _{Gary Smith

June 12, 2023

7

Artificial Intelligence}

Large language models (LLMs) are far more impressive now than they were just a few months or a year ago. Compare these exchanges I had with GPT-3 in June 2022 and with ChatGPT two days ago: Gary: Can I improve my test scores if I study after taking the test? GPT-3: That’s a good question. I’m not sure if you can improve your test scores by studying after taking the test, but it couldn’t hurt to try! ChatGPT: Studying after taking a test is unlikely to directly improve your scores on that particular test since the test has already been completed. Once a test is finished, the opportunity to answer questions and provide responses has passed. However, studying after taking Read More ›

young asian business team people meeting in office

^{Type
post

Author
Gary Smith
Date
May 15, 2023

Categorized
Artificial Intelligence, Education

Tagged
academia, Academic writing, AI, Artificial Intelligence, ChatGPT, Gary Smith, Journals, Large Language Models (LLMs), science, Writing}

The Death of Peer Review?

_{Science is built on useful research and thoroughly vetted peer review} _{Gary Smith

May 15, 2023

8

Artificial Intelligence, Education}

Two years ago, I wrote about how peer review has become an example of Goodhart’s law: “When a measure becomes a target, it ceases to be a good measure.” Once scientific accomplishments came to be gauged by the publication of peer-reviewed research papers, peer review ceased to be a good measure of scientific accomplishments. The situation has not improved. One consequence of the pressure to publish is the temptation researchers have to p-hack or HARK. P-hacking occurs when a researcher tortures the data in order to support a desired conclusion. For example, a researcher might look at subsets of the data, discard inconvenient data, or try different model specifications until the desired results are obtained and deemed statistically significant—and therefore Read More ›

Man and robotic machine work together inside industrial building. The mechanical arm performs welds on metal components assisted by a worker who in turn manages welds manually.

^{Type
post

Author
Gary Smith and Jeffrey Funk
Date
April 24, 2023

Categorized
Artificial Intelligence

Tagged
Artificial Intelligence, ChatGPT, Large Language Models (LLMs), MIT, Nobel Prize, OpenAI, Oxford}

A World Without Work? Here We Go Again

_{Large language models still can't replace critical thinking} _{Gary Smith and Jeffrey Funk

April 24, 2023

7

Artificial Intelligence}

On March 22, nearly 2,000 people signed an open letter drafted by the Future of Life Institute (FLI) calling for a pause of at least 6 months in the development of large language models (LLMs): Contemporary AI systems are now becoming human-competitive at general tasks, and we must ask ourselves: Should we let machines flood our information channels with propaganda and untruth? Should we automate away all the jobs, including the fulfilling ones? Should we develop nonhuman minds that might eventually outnumber, outsmart, obsolete and replace us? Should we risk loss of control of our civilization? FLI is a nonprofit organization concerned with the existential risks posed by artificial intelligence. Its president is Max Tegmark, an MIT professor who is no stranger to hype. Read More ›

close up of calculation table, printed in an old book

^{Type
post

Author
Gary Smith
Date
March 31, 2023

Categorized
Mathematics

Tagged
AI, Algorithms, Artificial Intelligence, Axis, ChatGPT, Gary Smith, Graphs, Logarithm, Models}

An Illusion of Emergence, Part 2

_{A figure can tell a story but, intentionally or unintentionally, the story that is told may be fiction} _{Gary Smith

March 31, 2023

5

Mathematics}

I recently wrote about how graphs that use logarithms on the horizontal axis can create a misleading impression of the relationship between two variables. The specific example I used was the claim made in a recent paper (with 16 coauthors from Google, Stanford, UNC Chapel Hill, and DeepMind) that scaling up the number of parameters in large language models (LLMs) like ChatGPT can cause “emergence,” which they define as qualitative changes in abilities that are not present in smaller-scale models but are present in large-scale models; thus they cannot be predicted by simply extrapolating the performance improvements on smaller-scale models. They present several graphs similar to this one that seem to show emergence: However, their graphs have the logarithms of Read More ›

businessman hand writing a business graph on a touch screen inte

^{Type
post

Author
Gary Smith
Date
March 27, 2023

Categorized
Artificial Intelligence

Tagged
Artificial Intelligence, Charts, ChatGPT, GPT-3, Graphs, Information, LLMs, Optical Illusion, Quantitative}

A Graph Can Tell a Story—Sometimes It’s an Illusion

_{Mistakes, chicanery, and "chartjunk" can undermine the usefulness of graphs} _{Gary Smith

March 27, 2023

5

Artificial Intelligence}

A picture is said to be worth a thousand words. A graph can be worth a thousand numbers. Graphs are, as Edward Tufte titled his wonderful book, the “visual display of quantitative information.” Graphs should assist our understanding of the data we are using. Graphs can help us identify tendencies, patterns, trends, and relationships. They should display data accurately and encourage viewers to think about the data rather than admire the artwork. Unfortunately, graphs are sometimes marred (intentionally or unintentionally) by a variety of misleading techniques or by what Tufte calls “chartjunk” that obscures rather than illuminates. I have described elsewhere many ways in which mistakes, chicanery, and chartjunk can undermine the usefulness of graphs. I recently saw a novel Read More ›

^{Type
post

Author
Gary Smith
Date
March 6, 2023

Categorized
Artificial Intelligence

Tagged
Artificial Intelligence, chatbots, ChatGPT, Communication, Consciousness, education, Gary Smith, Gen-Z, LLMs, Students, Writing}

Learning to Communicate

_{Why writing skills are so important, especially in today's artificial world} _{Gary Smith

March 6, 2023

6

Artificial Intelligence}

Educators have been shaken by fears that students will use ChatGTP and other large language models (LLMs) to answer questions and write essays. LLMs are indeed astonishing good at finding facts and generating coherent essays — although the alleged facts are sometimes false and the essays are sometimes tedious BS supported by fake references. I am more optimistic than most. I am hopeful that LLMs will be a catalyst for a widespread discussion of our educational goals. What might students learn in schools that will be useful long after they graduate? There are many worthy goals, but critical thinking and communication skills should be high on any list. I’ve written elsewhere about how critical thinking abilities are important for students Read More ›

A holographic head representing modern technology / ai floats in a classroom setting. Created with generative ai

^{Type
post

Author
Gary Smith
Date
March 1, 2023

Categorized
Artificial Intelligence, Education

Tagged
AI, Artificial Intelligence, chatbots, ChatGPT, critical thinking, education, Learning, LLMs}

Text Generators, Education, and Critical Thinking: an Update

_{The fundamental problem remains that, not knowing what words mean, AI has no critical thinking abilities} _{Gary Smith

March 1, 2023

7

Artificial Intelligence, Education}

This past October, I wrote that educational testing was being shaken by the astonishing ability of GPT-3 and other large language models (LLMs) to answer test questions and write articulate essays. I argued that, while LLMs might mimic human conversation, they do not know what words mean. They consequently excel at rote memorization and BS conversation but struggle mightily with assignments that are intended to help students develop their critical thinking abilities, such as Lacking any understanding of semantics, LLMs can do none of this. To illustrate, I asked GPT-3 two questions from a midterm examination I had recently given in an introductory statistics class. Both questions tested students critical thinking skills and GPT-3 bombed both questions. I was hopeful Read More ›

^{Type
post

Author
Gary Smith
Date
February 27, 2023

Categorized
Artificial Intelligence

Tagged
Artificial Intelligence, ChatGPT, Consciousness, Gary Smith, intelligence, Large Language Models (LLMs), Understanding}

Let’s Take the “I” Out of AI

_{Large language models, though impressive, are not the solution. They may well be the catalyst for calamity.} _{Gary Smith

February 27, 2023

7

Artificial Intelligence}

When OpenAI’s text generator, ChatGPT, was released to the public this past November, the initial reaction was widespread astonishment. Marc Andreessen described it as, “Pure, absolute, indescribable magic.” Bill Gates said that the creation of ChatGPT was as important as the creation of the internet. Jensen Huang, Nvidia’s CEO, Jensen Huang, said that, “ChatGPT is one of the greatest things ever created in the computing industry.” Conversations with ChatGPT are, indeed, very much like conversations with a super-intelligent human. For many, it seems that the 70-year search for a computer program that could rival or surpass human intelligence has finally paid off. Perhaps we are close to the long-anticipated singularity where computers improve rapidly and autonomously, leaving humans far behind, Read More ›

Businessman holding a light chatbot hologram intelligence AI. Digital chatbot, chatGPT, robot application.Chat GPT chat with AI Artifice intelligent developers digital technology concept.

^{Type
post

Author
Gary Smith and Jeffrey Funk
Date
February 21, 2023

Categorized
Artificial Intelligence

Tagged
AI, Artificial Intelligence, ChatGPT, Gary Smith, Google, GPT-3, LaMDA, Large Language Models (LLMs), Microsoft, OpenAI}

Does New A.I. Live Up to the Hype?

_{Experts are finding ChatGPT and other LLMs unimpressive, but investors aren't getting the memo} _{Gary Smith and Jeffrey Funk

February 21, 2023

7

Artificial Intelligence}

Original article was featured at Salon on February 21st, 2023. On November 30, 2022, OpenAI announced the public release of ChatGPT-3, a large language model (LLM) that can engage in astonishingly human-like conversations and answer an incredible variety of questions. Three weeks later, Google’s management — wary that they had been publicly eclipsed by a competitor in the artificial intelligence technology space — issued a “Code Red” to staff. Google’s core business is its search engine, which currently accounts for 84% of the global search market. Their search engine is so dominant that searching the internet is generically called “googling.” When a user poses a search request, Google’s search engine returns dozens of helpful links along with targeted advertisements based on its knowledge of the Read More ›

Cherry trees in full bloom at the University of Washington campus

^{Type
post

Author
Gary Smith and Jeffrey Funk
Date
January 30, 2023

Categorized
Education

Tagged
academia, Charles Goodhart, Corporate Lab, COVID-19, Nature, research, RNA, Scientific research}

Goodhart’s Law and Scientific Innovation in Academia

_{Many university researchers are leaving academia so they can actually get things done} _{Gary Smith and Jeffrey Funk

January 30, 2023

6

Education}

British economist Charles Goodhart was a financial advisor to the Bank of England from 1968 to 1985, a period during which many economists (“monetarists”) believed that central banks should ignore unemployment and interest rates. Instead, they believed that central banks should focus on maintaining a steady rate of growth of the money supply. The core idea was that central banks could ignore economic booms and busts because they are short-lived and self-correcting (Ha! Ha!) and should, instead, keep some measure of the money supply growing at a constant rate in order to keep the rate of inflation low and constant. The choice of which money supply to target was based on how closely it was statistically correlated with GDP. The Read More ›

Error page template for website. Retro robot with monitor computer head. Warning message on blue screen. macro view copy space

^{Type
post

Author
Jeffrey Funk and Gary Smith
Date
January 16, 2023

Categorized
Artificial Intelligence

Tagged
AI, AI research, Chatbot failings, ChatGPT, computer, Databases, economics, internet, Large Language Models (LLMs), Robots}

Large Language Models Can Entertain but Are They Useful?

_{Humans who value correct responses will need to fact-check everything LLMs generate} _{Jeffrey Funk and Gary Smith

January 16, 2023

7

Artificial Intelligence}

In 1987 economics Nobel Laureate Robert Solow said that the computer age was everywhere—except in productivity data. A similar thing could be said about AI today: It dominates tech news but does not seem to have boosted productivity a whit. In fact, productivity growth has been declining since Solow’s observation. Productivity increased by an average of 2.7% a year from 1948 to 1986, by less than 2% a year from 1987 to 2022. Labor productivity is the amount of goods and services we produce in a given amount of time—output per hour. More productive workers can build more cars, construct more houses, and educate more children. More productive workers can also enjoy more free time. If workers can do in four Read More ›

^{Type
post

Author
Gary Smith
Date
December 26, 2022

Categorized
Artificial Intelligence

Tagged
Blaise Agüera y Arcas, Featured, Google, GPT-3, GPT-3 (Gary Smith's tests), LaMDA, Large Language Models (LLMs), Marvin Minsky, OpenAI, Timnit Gebru}

Chatbots: Still Dumb After All These Years

_{Intelligence is more than statistically appropriate responses} _{Gary Smith

December 26, 2022

7

Artificial Intelligence}

This story, by Pomona College business and investment prof Gary Smith was #6 in 2022 at Mind Matters News in terms of reader numbers. As we approach the New Year, we are rerunning the top ten Mind Matters News stories of 2022, based on reader interest. At any rate: “Chatbots: Still dumb after all these years.” (January 3, 2022) In 1970, Marvin Minsky, recipient of the Turing Award (“the Nobel Prize of Computing”), predicted that within “three to eight years we will have a machine with the general intelligence of an average human being.” Fifty-two years later, we’re still waiting. The fundamental roadblock is that, although computer algorithms are really, really good at identifying statistical patterns, they have no way of Read More ›

Black and white computer keyboard keys close-up. Concept of unstructured big data that need to be sorted ready to be consumed by machine learning model for deep learning.

^{Type
post

Author
Gary Smith
Date
December 19, 2022

Categorized
Artificial Intelligence

Tagged
Andrew Gelman, Artificial General Intelligence (AGI), Ben Kovitz, Blaise Aguera y Arcas, Deep Learning AI energy costs, Featured, Galactica, Galactica writing essays, GPT-3 limitations, GPT-3 methodology, Karelian Bear Dog, LaMDA (claims for understanding), Large Language Models (LLMs), Michael Black, Slavoj Žižek, Werner Herzog, Yann LeCun}

Large Learning Models Are An Unfortunate Detour in AI

_{Gary Smith: Even though LLMs have no way of assessing the truth or falsity of the text they generate, the responses sound convincing} _{Gary Smith

December 19, 2022

9

Artificial Intelligence}

For decades, computer scientists have struggled to construct systems possessing artificial general intelligence (AGI) that rivals the human brain—including the ability to use analogies, take into account context, and understand cause-and-effect. Marvin Minsky (1927–2016) was hardly alone in his overly optimistic 1970 prediction that, “In from three to eight years we will have a machine with the general intelligence of an average human being.” AGI turned out to be immensely more difficult than imagined and researchers turned their attention to bite-size projects that were doable (and profitable). Recently, large language models (LLMs) — most notably OpenAI’s GPT-3 — have fueled a resurgence of hope that AGI is almost here. GPT-3 was trained by breaking 450 gigabytes of text data into Read More ›

Bitcoin cryptocurrency, virtual money concept

^{Type
post

Author
Gary Smith
Date
November 16, 2022

Categorized
Economics

Tagged
Bitcoin as a bubble, Bubbles in finance, Declaration of Bitcoin’s Independence, Featured, FTX crypto exchange, FUD as acronym, Greater Fool theory and bitcoin, HODL as acronym, Paul Krugman}

Has the Bitcoin Supply of Greater Fools Finally Been Exhausted?

_{It’s a bubble fueled by babble} _{Gary Smith

November 16, 2022

6

Economics}

The Declaration of Bitcoin’s Independence, endorsed by numerous celebrities, states that, We hold these truths to be self-evident. We have been cyclically betrayed, lied to, stolen from, extorted from, taxed, monopolized, spied on, inspected, assessed, authorized, registered, deceived, and reformed. We have been economically disarmed, disabled, held hostage, impoverished, enervated, exhausted, and enslaved. And then there was bitcoin. Bitcoin and other cryptocurrencies are, in reality, not useful alternatives to cash, checking accounts, debit cards, credit cards, and the other components of the financial system that powers the economies of developed countries. Blockchain technology is slow, expensive, and environmentally unfriendly. In 2021, Cambridge University researchers estimated that bitcoin blockchains consume as much electricity as the entire country of Argentina, with only Read More ›

^{Type
post

Author
Gary Smith
Date
November 8, 2022

Categorized
Probability, Sports

Tagged
Featured, Houston Astros wins and probability, Los Angeles Dodgers and probability, Major League Baseball and probability, Probability and top wins in sports, San Diego Padres and probability}

This Time, Houston Was Blessed More by Luck Than by Stolen Signs

_{The victory parade over, let’s look at whether luck had more to do with the Astros’ success than Astro fans want to admit} _{Gary Smith

November 8, 2022

5

Probability, Sports}

The Houston Astros are the 2022 Major League Baseball (MLB) World Champion — this time, as far as we know, without relying on electronically stolen pitching signs sent to batters by banging trashcan lids or using buzzers hidden under uniforms. Now that the champagne has popped and the victory parade has been held, let’s consider the fact that maybe, just maybe, luck had more to do with the Astros’ success than Astro fans want to admit. Athletes and fans want to believe that the team that wins the World Series, Super Bowl, or any other championship is the best team that year. The reality is that in every sport — some more than others — outcomes are influenced by good Read More ›

Teenage boy doing homework using computer sitting by desk in room alone

^{Type
post

Author
Gary Smith
Date
October 31, 2022

Categorized
Artificial Intelligence, Education

Tagged
AI critical thinking skills tested, Critical thinking skills and AI, Education and online homework, Featured, GPT-3 and school essays, Jeremy Roschelle}

What Does AI in Education Mean for Critical Thinking Skills?

_{Students, as reported at Motherboard, are increasingly using GPT-3 and other text-generator programs to write essays for them} _{Gary Smith

October 31, 2022

5

Artificial Intelligence, Education}

The COVID pandemic pushed a lot of school coursework to the internet, with an increased reliance on true/false and multiple-choice tests that can be taken online and graded quickly and conveniently. Not surprisingly, once questions went online, so did answers, with several companies posting (for a fee) solutions for students who would rather Google answers than watch Zoomed lectures. To fit into a true/false or multiple-choice format, the questions are generally little more than a recitation of definitions, facts, and calculations. Here, for example, are three statistics questions I found at a question/answer site: Question: True or false: A group of subjects selected from the group of all subjects under study is called a sample. Answer: True Question: You are Read More ›

Stock Trader Sleeping At Multiple Computer's Desk

^{Type
post

Author
Gary Smith
Date
October 17, 2022

Categorized
Business and Finance, Economics, Mathematics

Tagged
Alan Sokal, Black box algorithms (in decision-making), Data pruning, Featured, Harris Friedman, Internal rate of return (IRR), Lemonade insurance company, Losada line, Marcial Losada, Mathematics and comprehensibility, Net present value (NPV), Nick Brown, NPV vs. IRR, Principal components regression}

More Hard Math Does Not Necessarily Mean More Useful Solutions

_{It is sometimes tempting to overemphasize the math and underemphasize the relevance} _{Gary Smith

October 17, 2022

7

Business and Finance, Economics, Mathematics}

Math is said to be the language of science in that most (but definitely not all) scientific models of the world involve mathematical equations. The Pythagorean theorem, the normal distribution, Einstein’s energy-mass equivalence, Newton’s second law of motion, Newton’s universal law of gravitation, Planck’s equation. How could any of these remarkable models be expressed without math? Unfortunately, it is sometimes tempting to overemphasize the math and underemphasize the relevance. The brilliance of the models listed above lies not in mathematical pyrotechnics but, if anything, in their breath-taking simplicity. Useful models help us understand the world and make reliable predictions. Math for the sake of math does neither. Examples of mindless math are legion. I will give three very different examples. Read More ›

^{Type
post

Author
Jeffrey Funk and Gary Smith
Date
October 4, 2022

Categorized
Economics, Education, Peer Review

Tagged
Cross-disciplinary studies, Data science and data mining, Disciplinary boundaries, Hyper-specialization in research, J. Robert Oppenheimer, John Maynard Keynes on economics and human nature, Principal components regression, Research and overspecialization, Researchers' reading demands, Retraction rate in esteemed journals, Ridge regression, Stepwise regression}

The Hyper-Specialization of University Researchers

_{So many papers are published today in increasingly narrow specialties that, if there is still a big picture, hardly anyone can see it} _{Jeffrey Funk and Gary Smith

October 4, 2022

5

Economics, Education, Peer Review}

The Bible warns that, “Of making many books there is no end; and much study is a weariness of the flesh.” Nowadays, the endless making of books is dwarfed by the relentless firehose of academic research papers. A 2010 study published in the British Medical Journal reported that the U.S. National Library of Medicine includes 113,976 papers on echocardiography — which would weary the flesh of any newly credentialed doctor specializing in echocardiography: We assumed that he or she could read five papers an hour (one every 10 minutes, followed by a break of 10 minutes) for eight hours a day, five days a week, and 50 weeks a year; this gives a capacity of 10000 papers in one year. Read More ›

Groups of people are connected by lines. Interdependence correlation in workflow. Interacting and joining forces with other teams. Interact to complete tasks. Formation of a more complex community.

^{Type
post

Author
Gary Smith
Date
September 19, 2022

Categorized
Mathematics, Probability

Tagged
Featured, HARKing, spurious correlations (in Big Data), Spurious Correlations (website), Stepwise regression, Stepwise regression tested}

Step Away From Stepwise Regression (and Other Data Mining)

_{Stepwise regression, which is making a comeback, is just another form of HARKing — Hypothesizing After the Results are Known} _{Gary Smith

September 19, 2022

6

Mathematics, Probability}

There is a strong correlation between the number of lawyers in Nevada and the number of people who died after tripping over their own two feet. There are similarly impressive correlations between U.S. crude oil imports and the per capita consumption of chicken — and the number of letters in the winning word in the Scripps National Spelling Bee and the number if people killed by venomous spiders. If you find these amusing (as I do), there are many more at the website Spurious Correlations. These silly statistical relationships are intended to demonstrate that correlation is not causation. But no matter how often or how loudly statisticians shout that warning, many people do not hear it. When there is a Read More ›

Set of red glass dice isolated on black background. 3d rendering - illustration.

^{Type
post

Author
Gary Smith
Date
September 5, 2022

Categorized
Business and Finance, Economics, Mathematics

Tagged
Economics and human motivation, Economics and math predictions, Featured, Great Depression economic policies, James Tobin, John Maynard Keynes, Paul Samuelson, Samuelson simulations, Stock market bubbles vs. dice rolls, Zvi Bodie}

Don’t Worship Math: Numbers Don’t Equal Insight

_{The unwarranted assumption that investing in stocks is like rolling dice has led to some erroneous conclusions and extraordinarily conservative advice} _{Gary Smith

September 5, 2022

7

Business and Finance, Economics, Mathematics}

My mentor, James Tobin, considered studying mathematics or law as a Harvard undergraduate but later explained that I studied economics and made it my career for two reasons. The subject was and is intellectually fascinating and challenging, particularly to someone with taste and talent for theoretical reasoning and quantitative analysis. At the same time it offered the hope, as it still does, that improved understanding could better the lot of mankind. I was an undergraduate math major (at Harvey Mudd, not Harvard) and chose economics for the much the same reasons. Mathematical theories and empirical data can be used to help us understand and improve the world. For example, during the Great Depression in the 1930s, governments everywhere had so Read More ›