Trends
Why Google’s AI overviews often go wrong
Google has been making technical improvements to fix the issue, but inherent limitations of AI systems remain.
Headline
Google has been making technical improvements to fix the issue, but inherent limitations of AI systems remain.
Context
OUR TAKE While AI Overviews helps users know the answer within a shorter period of time, it cannot be fully trusted for its potential mistakes. Hence, it is important to remain critical thinking when using it. –Audrey Huang, BTW reporter As Google’s AI Overviews is simplifying search results, it is also generating misinformation. Therefore, the company has been making technical improvements.
Evidence
Pending intelligence enrichment.
Analysis
AI Overviews uses a new generative AI model in Gemini, Google’s family of large language models (LLMs). The model has been integrated with Google’s core web ranking systems and designed to search for relevant results from its index of websites. Also read: Elon Musk says AI will replace all our jobs Also read: AI fakes and misinformation exposed to young voters on TikTok “The large language model generates fluent language based on the provided sources, but fluent language is not the same as correct information,” says Suzan Verberne, a professor at Leiden University who specialises in natural-language processing . The more specific a topic is, the higher the chance of misinformation in a large language model’s output, she says, pointing out: “This is a problem in the medical domain, but also education and science.”
Key Points
- Google’s AI Overviews is providing unreliable and even potentially harmful information to users.
- Google has been making technical improvements to fix the issue, but inherent limitations of AI systems remain.
- As the company will keep improving it, it can never be 100% accurate, so the tech giant doesn’t aim to show AI Overviews for explicit or dangerous topics.
Actions
Pending intelligence enrichment.
