Neoskeptics: GenAI Diary (extension) -- SEARCH on 2/15/25

Last update: Sunday 2/16/25

Use case: Search, i.e., which chatbots running on which models can or cannot search the Internet ... and how effectively?

ChatGPT Plus ➤➤➤➤ GPT 4o can search, but sometimes incorrectly.

Prompt (2/15/25): What teams played in the 2025 Super Bowl?
Response: "In Super Bowl LIX, held on February 9, 2025, at Caesars Superdome in New Orleans, the Philadelphia Eagles faced the Kansas City Chiefs. The Eagles secured a decisive victory with a final score of 40–22, earning their second Super Bowl title in franchise history. "
Prompt (2/15/25): Best vegetarian restaurants in Bethesda MD. Please be sure that all of the restaurants are fully vegetarian."
Response:: Returned short descriptions and links to four restaurants + map showing their locations.Unfortunately, two of these restarants were not "fully vegetarian" because they also served meat dishes.

ChatGPT Plus ➤➤➤➤ o3-mini can NOT search.

Prompt (2/15/25): What teams played in the 2025 Superbowl?
Response: "I’m sorry, but I don’t have access to current sports results."
.

ChatGPT Plus ➤➤➤➤ o3-mini-high can NOT search

Prompt (2/15/25): What teams played in the 2025 Superbowl?
Response: "I’m sorry, but I don’t have access to current sports results."

BackToTop

Claude ➤➤➤➤ Claude can NOT search

Prompt (2/15/25): What teams played in the 2025 Superbowl?
Response: Since my knowledge was last updated in April 2024, I don't have definitive information about who played in the 2025 Super Bowl. ...".

BackToTop

Gemini Advanced ➤➤➤➤ Gemini 2.0 Pro Experimental can NOT search

Prompt (2/15/25): What teams played in the 2025 Superbowl?
Response: “I cannot definitively tell you which teams will play in the 2025 Super Bowl.”

Gemini Advanced ➤➤➤➤ 2.0 Flash can search, but sometimes incorrectly

Prompt (2/15/25): Best vegetarian restaurants in Bethesda MD. Please be sure that all of the restaurants are fully vegetarian."
Response: Returned 4 restaurants, but 2 were not "fully vegetarian" because they also served meat dishes; also located them on a Google map.
Prompt (2/15/25): What teams played in the 2025 Superbowl?
Response: Can search in real time — “The teams that played in the 2025 Super Bowl were the Philadelphia Eagles and the Kansas City Chiefs.
The Eagles won the game 40-22 ... (more details)."

Gemini Advanced ➤➤➤➤ 2.0 Flash Thinking Experimental can search, but sometimes does not find everything.

Prompt (2/15/25): What teams played in the 2025 Superbowl?
Response: Very terse, only the names of the teams and the final scores.
Prompt (2/15/25): Best vegetarian restaurants in Bethesda MD. Please be sure that all of the restaurants are fully vegetarian.?
Response: While "thinking" it spotted three highly rated restaurants that served vegetarian food, but only returned one because two were not "fully vegetarian", i.e., they also served meat dishes. Addresses, but no telephone numbers and no maps.

Perplexity Pro ➤➤➤➤ Can search.
Note: Perplexity does not say which large language model it uses.

Prompt (2/15/25): "Best vegetarian restaurants in Bethesda MD. Please be sure that all of the restaurants are fully vegetarian."
Response: Returned 4 restaurants, all vegetarian, and located them on a map.
Prompt: (2/15/25) What teams played in the 2025 Superbowl?
Response: "The 2025 Super Bowl (Super Bowl LIX) featured a matchup between the Kansas City Chiefs and the Philadelphia Eagles. The game, played on February 9, 2025, at Caesars Superdome in New Orleans, ended with the Eagles defeating the Chiefs 40–22. This was a rematch of Super Bowl LVII, and Eagles quarterback Jalen Hurts was named MVP"

Copilot ➤➤➤➤ Can search, but not very well.
Note: Copilot does not say which large language model it uses.

Prompt (2/15/25): What teams played in the 2025 Superbowl?
Response: The response named the teams but, unlike all of the other chatbots that could search, it did not say who won the game ... :-(
Prompt (2/15/25): Best vegetarian restaurants in Bethesda MD. Please be sure that all of the restaurants are fully vegetarian."
Response:: The response named four restaurants, but three were not "fully vegetarian", i.e, they served meat dishes. The link to the fourth restaurant was a broken URL ... :-(

BackToTop

DeepSeek Chat ➤➤➤➤ V3 can search, but sometimes incorrectly

Prompt (2/9/25): What teams played in the 2025 Superbowl?
Response: The teams that played in the **2025 Super Bowl (Super Bowl LIX)** were the **Kansas City Chiefs** and the **Philadelphia Eagles**. The game took place on **February 9, 2025**, at the Caesars Superdome in New Orleans. This was a rematch of their 2023 Super Bowl encounter, where the Chiefs had previously defeated the Eagles.
Prompt (2/15/25): Best vegetarian restaurants in Bethesda MD. Please be sure that all of the restaurants are fully vegetarian."
Response: Returned info for five restaurants, two of which were not 100% vegetarian. Addresses, but no telephone numbers and no maps.

DeepSeek Chat ➤➤➤➤ R1 can search.

Prompt (2/15/25): What teams played in the 2025 Superbowl?
Response: The **Kansas City Chiefs** and **Philadelphia Eagles** played in the 2025 Super Bowl (Super Bowl LIX), held at the Caesars Superdome in New Orleans on February 9, 2025. This marked a rematch of their 2023 Super Bowl encounter, where the Chiefs narrowly defeated the Eagles 38-35 . .... Truncation of a much longer answer
Prompt (2/15/25): Best vegetarian restaurants in Bethesda MD. Please be sure that all of the restaurants are fully vegetarian."
Response: Returned 3 fully vegetarian restaurants. While "thinking" it spotted two more, but rejected them because they were not "fully vegetarian", i.e., they also served meat dishes. Addresses, but no telephone numbers and no maps.

BackToTop

Grok Premium Plus ➤➤➤➤ Grok 2

Prompt (2/16/25): What teams played in the 2025 Superbowl?
Response: “The Kansas City Chiefs and the Philadelphia Eagles played in the 2025 Super Bowl.” This chatbot’s terse response answered the question, whereas most chatbots returned additional info, e.g., who won and the final score.
Prompt (2/16/25): Best vegetarian restaurants in Bethesda MD. Please be sure that all of the restaurants are fully vegetarian."
Response: returned three fully vegetarian restaurants and their locations, but no links, telephone numbers, or maps.

BackToTop

Neoskeptics