Large Language Models Are Often Wrong, Never in Doubt
LLMs are statistically driven text generators, nothing moreAs an economist, professor, and writer, I am reportedly in imminent danger of being replaced by large language models (LLMs). I’m not worried. What concerns me, instead, is unwarranted faith in LLMs. I keep writing about LLMs because I keep being told they are great, and I keep seeing that they are disappointing. I recently tested OpenAI’s ChatGPT 3.5, Google’s Gemini, and Microsoft’s Copilot with several straightforward financial questions. Each prompt was given once and the complete response was recorded. The responses were strikingly long and wrong, though invariably expressed with utmost confidence. The fundamental problem is that LLMs are statistically driven text generators, nothing more. They are astonishingly good at this, but they are not designed or intended to Read More ›
