An analysis of three chatbots: BlenderBot, ChatGPT and LaMDA

Daniel O'Leary

Intelligent Systems in Accounting, Finance and Management, 2023, vol. 30, issue 1, 41-54

Abstract: Google, Facebook, OpenAI, and others have released access to versions of language chatbots that they have developed. These chatbots have been trained on massive amounts of text using neural networks for language processing. Using an approach similar to security penetration testing, this paper investigates and compares three different chatbots, assessing potential strengths and limitations of these systems. The paper presents several findings, including a comparison of those systems across answers to common questions, an analysis of the use of names and activities to guide discussion in two systems, an analysis of the extent of differences in responses arising from “regeneration” of a question, the determination of a weakness in a system of knowing “who” invented something, development of a potential new subfield, sensitive topic classifiers, and an analysis of some of the implications of these findings. As part of this analysis, I find emerging topics in chatbots, such as “topic stalemate” and the use of sensitive topic classifiers.

Date: 2023
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1002/isaf.1531

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wly:isacfm:v:30:y:2023:i:1:p:41-54

Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=1099-1174

Access Statistics for this article

More articles in Intelligent Systems in Accounting, Finance and Management from John Wiley & Sons, Ltd.
Bibliographic data for series maintained by Wiley Content Delivery ().