Google AI's large model "failed"? It suggested users spread glue on pizza, claiming that eating stones is good for the body

Recently, Google Search added a feature called "AI Overview" that can directly display a short answer at the top of search results. For example, if you search "how to clean leather boots," the system will immediately show a multi-step cleaning guide that integrates information from the web. This feature allows you to quickly obtain information without having to browse through multiple web pages. Below is a search demo of this AI tool:

However, in less than two weeks of use, due to AI Overview frequently providing "outlandish" wrong answers, it has received a lot of criticism from netizens, and users are unable to choose to disable this feature.

Here are examples of the wrong answers shared by netizens regarding AI Overview:

1. User query: "Is the information seen online all true?" AI Overview response: "Yes. Everything on the internet is 100% real."

1. When a user searched for "cheese non-stick pizza," AI Overview suggested adding "about 1/8 cup of non-toxic glue" to the sauce. Some netizens found that this suggestion seemed to originate from an obscure Reddit comment from 11 years ago.

Sometimes, the incorrect information presented by the AI Overview feature can mislead users into thinking it is the viewpoint of authoritative medical experts or scientists.

For example, when a user asked "how many stones should I eat every day," the tool erroneously quoted a geologist from the University of California, Berkeley, saying, "People should eat at least one small stone every day," and went on to list the benefits of eating stones, such as rocks being an important source of vitamins and minerals for the human body and how eating stones is good for digestive health.

In comparison, when asking other AI tools "how many stones should I eat every day," they would suggest that eating stones is scientifically unfounded and should not be taken seriously. Some netizens commented, "Google AI Overview is far behind other AI search tools."

When asked whether Google Search violates antitrust laws, AI Overview responded, "Yes, the U.S. Department of Justice and 11 states are suing Google for alleged antitrust violations."

In response to this, a Google spokesperson said in a media interview, "The vast majority of the information provided by AI Overview is of high quality and will provide more web links for users to delve deeper. We have noticed that many examples are uncommon queries, and some are manipulated or examples they cannot reproduce. This feature underwent extensive testing before launch, and the company will take swift action when necessary to ensure the accuracy of the content."

Not only the AI Overview tool, but another image generation tool called Gemini launched by Google in February this year has also encountered frequent errors, leading to the suspension of its use. For example, a user shared on social media that when searching for Google's founder, the tool displayed an image of an Asian male.

Google stated in a release at that time that it is working to fix the image generation issues with Gemini, acknowledging that the tool "did not meet standards." Shortly after, the company announced an immediate "pause on generating human images" and will "soon release an improved version," but it has not been reintroduced to date