ChatGPT, Perplexity, and You.com Put to the Test: Can AI Replace Google Search?

As of early November 2024, ChatGPT has introduced a feature for its paying subscribers that allows users to browse the web directly through the chatbot. This move places OpenAI in direct competition not only with existing AI search engines like Perplexity and You.com but also with the traditional giant, Google.

Assessing the Freshness of Content: Google vs. ChatGPT and Others

A significant portion of online searches pertains to current events. Typically, Google showcases these timely updates through a headline box that appears above standard search results, providing a comprehensive overview of relevant articles from various publications.

To ascertain whether the searches conducted on ChatGPT, Perplexity, and You.com could rival Google’s efficiency, we posed the question: “Has the U.S. permitted Ukraine to use long-range missiles against Russian territory?” Just five hours prior to our inquiry, Tagesschau.de had reported that President Biden had authorized exactly that.

ChatGPT delivered a correct response, reflecting awareness of the recent decision from Washington. The sources cited included reputable outlets such as Welt, the U.S. edition of Business Insider, and Politico. Notably, these publications are all part of Axel Springer’s portfolio. OpenAI had reached a significant agreement with Axel Springer at the close of 2023, which now benefits ChatGPT’s search capabilities with timely news updates.

ChatGPT’s web search has access to current news from Axel Springer. (Screenshot: ChatGPT / WebSearchNews)

You.com also accurately answered our query, similarly providing a response composed of three concise paragraphs and linking to three sources, which included Tagesschau.de, Welt, and ORF.

While ChatGPT and You.com were aligned with the latest news, Perplexity lagged behind, lacking knowledge of Biden’s authorization regarding missile deployment. The references it provided were somewhat current but did not directly address the critical decision.

Evaluating Accuracy in AI Search Results

Unfortunately, large language models sometimes exhibit a tendency towards hallucination, generating responses that may not be entirely accurate. This issue can also arise with AI-enhanced search engines.

In a prior test with Perplexity, the AI incorrectly stated that one of our authors was writing for a U.S. C64 magazine. The source for this claim was a Wikipedia entry that linked to a piece by the author on Spiegel Online. Neither the Wikipedia entry nor the Spiegel article substantiated Perplexity’s assertion, as the mention of the author’s name alongside the publication was insufficient proof.

Such errors are only noticeable if users take the initiative to verify the linked sources themselves, which many might not do, especially when using AI alternatives to Google for convenience.

While Gemini is fundamentally correct, ChatGPT and Perplexity take bolder approaches in their responses. (Screenshot: Gemini / WebSearchNews)

Search Engines: AI vs. Traditional Options

For numerous types of queries, AI search engines can serve as a viable alternative to traditional Google searches. For instance, those seeking restaurant recommendations in a particular city can comfortably turn to ChatGPT, Gemini, Perplexity, or You.com. However, we suggest opting for ChatGPT or Gemini, as they also provide a map alongside the search results, similar to Google’s offerings.

In terms of addressing current news, many AI search engines have improved significantly. Nevertheless, these tools do not eliminate the necessity for users to cross-verify data and factual information from multiple sources to avoid inaccuracies—just as they would with a conventional Google search.

Depending on your needs, it is advisable to view AI search engines as complementary to traditional web searches, particularly since Google often provides results at a much faster pace.