AI chatbots like OpenAI's ChatGPT, Microsoft Corp.'s (NASDAQ:MSFT) Copilot and others can sometimes generate responses or output that is nonsensical. This is known as hallucination. While it does happen sometimes, not everyone knows the reason behind it.
What Happened: Meta Platforms Inc.'s (NASDAQ:META) chief AI scientist and "Godfather of AI" Yann LeCun has explained exactly why AI chatbots hallucinate, in an episode of the Lex Fridman podcast.
Hallucination in AI refers to the phenomenon where large language models (LLMs) generate responses or outputs that are nonsensical, irrelevant, or disconnected from the input or context.
But why does it happen? Why do chatbots like ChatGPT and Copilot lose it?
"Because of the autoregressive prediction, every time an AI produces ...