Publication Type
Conference Proceeding Article
Version
publishedVersion
Publication Date
11-2021
Abstract
Task-oriented dialogue agents are built to assist users in completing various tasks. Generating appropriate responses for satisfactory task completion is the ultimate goal. Hence, as a convenient and straightforward way, metrics such as success rate, inform rate etc., have been widely leveraged to evaluate the generated responses. However, beyond task completion, there are several other factors that largely affect user satisfaction, which remain under-explored. In this work, we focus on analyzing different agent behavior patterns that lead to higher user satisfaction scores. Based on the findings, we design a neural response generation model EnRG. It naturally combines the power of pre-trained GPT-2 in response semantic modeling and the merit of dual attention in making use of the external crowd-sourced knowledge. Equipped with two gates via explicit dialogue act modeling, it effectively controls the usage of external knowledge sources in the form of both text and image. We conduct extensive experiments. Both automatic and human evaluation results demonstrate that, beyond comparable task completion, our proposed method manages to generate responses gaining higher user satisfaction.
Keywords
Crowd-sourced knowledge, Response generation, Task-oriented
Discipline
Artificial Intelligence and Robotics
Research Areas
Intelligent Systems and Optimization
Publication
Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI, Virtual Event, China, 2021 October 20
First Page
3
Last Page
11
ISBN
9781450386791
Identifier
10.1145/3475959.3485392
Publisher
Association for Computing Machinery
City or Country
Chengdu
Citation
HE, Yingxu; LIAO, Lizi; ZHANG, Zheng; and CHUA, Tat-Seng.
Towards enriching responses with crowd-sourced knowledge for task-oriented dialogue. (2021). Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI, Virtual Event, China, 2021 October 20. 3-11.
Available at: https://ink.library.smu.edu.sg/sis_research/7583
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Additional URL
https://dl.acm.org/doi/10.1145/3475959.3485392