Document Type
Presentation
Publication Date
October 2023
Journal
FIMS
Abstract
Introduced by Microsoft in February 2023, Bing Chat is a feature of the Bing search engine that integrates an OpenAI large language model (LLM) customised for search (Mehdi, 2023a). This poster compares the outputs of Bing Chat and a standard existing search engine (DuckDuckGo) in response to identical keyword queries and corresponding natural language (NL) questions. Specifically, we examined: (1) the length of Bing Chat’s responses and DuckDuckGo’s first page of search results, by number of website links; and, (2) the length of Bing Chat’s textual summaries, by number of website links. We found that, on average, significantly fewer websites were linked to in Bing Chat’s responses compared to DuckDuckGo’s search results. Our findings have important implications for website operators, who may receive less traffic and ad revenue if LLM-enabled search engines are widely adopted in the future. Human-Computer Interaction (HCI) will inevitably face the need for more research on human information behaviours adaptations in response to the changing search paradigm.