Integrating breakdown detection into dialogue systems to improve knowledge management: encoding temporal utterances with memory attention

Seolhwa Lee (), Dongyub Lee (), Danial Hooshyar (), Jaechoon Jo () and Heuiseok Lim ()
Additional contact information
Seolhwa Lee: Korea University
Dongyub Lee: Kakao
Danial Hooshyar: University of Tartu
Jaechoon Jo: Sangmyung University
Heuiseok Lim: Korea University

Information Technology and Management, 2020, vol. 21, issue 1, No 5, 59 pages

Abstract: Abstract With the increasing pervasiveness of smart phones and smart devices, dialogue systems are gaining ever growing attention from both academic and industry. These systems can be broadly classified into two categories, one that is aimed at helping user to gain new knowledge and one that can chat with users without completing any specific tasks. Although dialogue systems are improving substantially, the user experience of such systems are still unsatisfactory as there are no specific rules covering all possible situations of real human–machine dialogue, resulting in breakdowns. There are two technical issues affecting the detection of dialogue breakdown in an open domain conversation: human resources to prepare and annotate a large chunk of conversation data and dialogue histories containing words that don’t appear directly in training data. To tackle these issues, we propose a novel encoding method for temporal utterances with memory attention based on end-to-end dialogue breakdown detection. Specifically, long short-term memory (LSTM) is employed to encode each word of all previous user and system utterances. Encoded vectors from LSTM (user and system utterances), along with system and user utterances from sentence embedding, are then stored in memory wherein an attention mechanism is applied to select the most relevant piece of words from system and user utterances for breakdown detection. An evaluation of the proposed approach on a breakdown detection task (DBDC3) showed that the model for single-labeled breakdown detection outperforms other state-of-the-art methods in a classification task. In conclusion, a more effective knowledge gain and management can be achieved by integration of our proposed breakdown detection into dialogue systems.

Keywords: Knowledge management; Breakdown detection; Dialogue system; Memory attention (search for similar items in EconPapers)
Date: 2020
References: View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
http://link.springer.com/10.1007/s10799-019-00308-x Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:infotm:v:21:y:2020:i:1:d:10.1007_s10799-019-00308-x

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/10799

DOI: 10.1007/s10799-019-00308-x

Access Statistics for this article

Information Technology and Management is currently edited by Raymond Patterson and Erik Rolland

More articles in Information Technology and Management from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().