Google’s AI Overviews Keep Making Weird Mistakes — And Researchers Say It’s Hard to Fix

[tradelikepro]

Google’s AI Search overhaul is facing fresh backlash after users discovered its AI Overview feature giving bizarre answers to basic spelling questions. Examples circulating online include incorrect letter counts, misspelled words, and even a failed attempt to spell former President Trump’s last name correctly.

Google acknowledged the issue, saying that “counting within words has been a known challenge for LLMs,” but experts suggest the problem runs deeper than a simple bug. Researchers explain that AI language models don’t actually “read” text the way humans do. Instead, they break language into tokens and mathematical patterns, meaning they often struggle with tasks involving exact spelling or letter-by-letter analysis.

The controversy arrives as Google pushes aggressively toward an AI-first version of Search, replacing many traditional search results with generated summaries and conversational answers. Critics argue the repeated mistakes show that even advanced AI systems still lack reliability for factual precision, especially when users assume the responses are authoritative simply because they appear directly inside Google Search.

[encrypted]

google’s ai can summarize global geopolitics but occasionally forgets how many letters are in a word

[encrypted]

humanity built trillion dollar neural networks only to rediscover spellcheck was harder than expected