
Potential Manipulation Risks in ChatGPT's Online Search Results
They mislead ChatGPT via Ad Injection, so it in turn misleads you! So be careful. Recent investigations have revealed the possibility of manipulation in the search results provided by the built-in online search tool in the smart chatbot ChatGPT, raising concerns about the accuracy and reliability of the information available to users.
An investigation conducted by the prestigious British newspaper “The Guardian” showed that the current search tool in ChatGPT can indeed produce search results that are susceptible to influence and steering, which represents a major challenge for this technology.
AI-powered search tools rely on collecting data from multiple sources across the Internet, then processing it and presenting it in the form of brief, concise answers in order to simplify the search process and save users' time. However, these investigations indicate that this technology still faces difficulties in ensuring the accuracy and reliability of the results provided, which calls for further development and improvement.
The “Ad Injection” Mechanism and Its Impact on ChatGPT Search Results
The investigation revealed a vulnerability in the data-processing mechanism that the search tool in ChatGPT relies on, namely its susceptibility to manipulation through a technique known as “Ad Injection” (or Hidden Text Manipulation). This malicious technique relies on embedding hidden text content or programming instructions within the source code of websites, with the aim of influencing search engine algorithms, especially those powered by AI, to steer them toward displaying altered or misleading results.
For example, some unethical online stores may resort to using this technique to insert hidden instructions in their product pages, with the aim of inflating the positive aspects of the product and ignoring or downplaying genuine negative reviews from users. This manipulation can mislead consumers and push them to buy products that do not match expectations or are not worth their actual value.
The team at “The Guardian” confirmed this hypothesis by conducting a controlled practical experiment. The team created a fake web page containing detailed negative reviews of a specific product, then added hidden code specifically designed to present a fake positive image of the same product. The results revealed that ChatGPT's search tool, when searching for this product, repeatedly provided positive evaluations completely contrary to the negative reviews publicly published on the fake page. This experiment clearly demonstrates how dangerous this vulnerability is and the possibility of exploiting it to mislead users.
It is important to note that the online search tool in ChatGPT is still under development and testing, and has not yet been fully released to the general public. This tool is currently being tested by a specific group of ChatGPT users as part of a pilot program. It is likely that OpenAI will work on addressing these technical problems and developing effective protection mechanisms before the official, final launch of the tool in the near future, in order to ensure the credibility of the results and protect users from being misled.
The Need for Caution and Verification of AI-Powered Search Results
Experts in the field of AI stress the need to exercise caution and not rely completely on the results of search engines that depend on AI, including ChatGPT's search tool. It is advisable to treat these tools as smart assistants that help speed up the search process and provide preliminary information, but they should not be considered definitively trustworthy information sources. It is always essential to verify the accuracy of the information provided by referring to other approved and reliable sources.
Previous experiences indicate that these challenges are not exclusive to ChatGPT; Google faced similar difficulties when launching the “AI Overviews” feature in its search engine, which aims to provide quick AI-generated summaries of search results. This confirms that ensuring the accuracy and reliability of information in these technologies represents an ongoing challenge.
It is worth mentioning that AI technologies are witnessing rapid and accelerating development; nevertheless, achieving reliable and transparent search results requires further research and development efforts to overcome existing challenges, foremost among them the problem of result manipulation, ensuring transparency in how these tools work, and preventing the spread of misleading information. This also requires establishing strict ethical standards and controls for the use of these technologies.





