Publication Type
Journal Article
Version
publishedVersion
Publication Date
1-2022
Abstract
Answer selection, which is involved in many natural language processing applications, such as dialog systems and question answering (QA), is an important yet challenging task in practice, since conventional methods typically suffer from the issues of ignoring diverse real-world background knowledge. In this article, we extensively investigate approaches to enhancing the answer selection model with external knowledge from knowledge graph (KG). First, we present a context-knowledge interaction learning framework, Knowledge-aware Neural Network, which learns the QA sentence representations by considering a tight interaction with the external knowledge from KG and the textual information. Then, we develop two kinds of knowledge-aware attention mechanism to summarize both the context-based and knowledge-based interactions between questions and answers. To handle the diversity and complexity of KG information, we further propose a Contextualized Knowledge-aware Attentive Neural Network, which improves the knowledge representation learning with structure information via a customized Graph Convolutional Network and comprehensively learns context-based and knowledge-based sentence representation via the multi-view knowledge-aware attention mechanism. We evaluate our method on four widely used benchmark QA datasets, including WikiQA, TREC QA, InsuranceQA, and Yahoo QA. Results verify the benefits of incorporating external knowledge from KG and show the robust superiority and extensive applicability of our method.
Keywords
Answer selection, knowledge graph, attention mechanism, graph convolutional network
Discipline
Databases and Information Systems | OS and Networks
Research Areas
Data Science and Engineering
Areas of Excellence
Digital transformation
Publication
ACM Transactions on Information Systems
Volume
40
Issue
1
First Page
1
Last Page
33
ISSN
1046-8188
Identifier
10.1145/3457533
Publisher
Association for Computing Machinery (ACM)
Citation
DENG, Yang; XIE, Yuexiang; LI, Yaliang; YANG, Min; LAM, Wai; and SHEN, Ying.
Contextualized knowledge-aware attentive neural network: Enhancing answer selection with knowledge. (2022). ACM Transactions on Information Systems. 40, (1), 1-33.
Available at: https://ink.library.smu.edu.sg/sis_research/9087
Copyright Owner and License
Authors
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Additional URL
https://doi.org/10.1145/3457533