Evaluating Media Knowledge Capabilities of Intelligent Search Dialogue Systems: A Case Study of ChatGPT and New Bing

Li-Yuan Huang, Xun Zhang, Qiang Wang, Zhen-Song Chen () and Yang Liu ()
Additional contact information
Li-Yuan Huang: Wuhan Technology and Business University
Xun Zhang: Beijing Qingbo Intelligent Technology Co., Ltd.
Qiang Wang: Wuhan University
Zhen-Song Chen: Wuhan University
Yang Liu: ZhongNan Hospital of Wuhan University, Wuhan University

Journal of the Knowledge Economy, 2024, vol. 15, issue 4, No 65, 17284-17307

Abstract: Abstract This study establishes an index system for evaluating the media knowledge capabilities of intelligent search dialogue systems (ISDS), which includes three primary indicators: dialogue ability, special ability, and output value. Survey data from relevant users are used to analyze the reliability and validity of the index system. An empirical comparison indicates that ChatGPT outperforms New Bing in understanding and dialogue capabilities, whereas New Bing excels in output content value. This paper also proposes new dimensions for ISDS, emphasizing their positive impact on knowledge production and dissemination. Nonetheless, ISDS also pose a series of risks and problems, including data privacy leaks and ethical challenges, which urgently need researching and addressing.

Keywords: Intelligent search dialogue system; Media knowledge capabilities; ChatGPT; New Bing (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s13132-024-01755-w Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:jknowl:v:15:y:2024:i:4:d:10.1007_s13132-024-01755-w

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/13132

DOI: 10.1007/s13132-024-01755-w

Access Statistics for this article

Journal of the Knowledge Economy is currently edited by Elias G. Carayannis

More articles in Journal of the Knowledge Economy from Springer, Portland International Center for Management of Engineering and Technology (PICMET)
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().