Publication Type
Conference Proceeding Article
Version
acceptedVersion
Publication Date
7-2022
Abstract
Generating fluent and informative natural responses while maintaining representative internal states for search optimization is critical for conversational search systems. Existing approaches either 1) predict structured dialog acts first and then generate natural response; or 2) map conversation context to natural responses directly in an end-to-end manner. Both kinds of approaches have shortcomings. The former suffers from error accumulation while the semantic associations between structured acts and natural responses are confined in single direction. The latter emphasizes generating natural responses but fails to predict structured acts. Therefore, we propose a neural co-generation model that generates the two concurrently. The key lies in a shared latent space shaped by two informed priors. Specifically, we design structured dialog acts and natural response auto-encoding as two auxiliary tasks in an interconnected network architecture. It allows for the concurrent generation and bidirectional semantic associations. The shared latent space also enables asynchronous reinforcement learning for further joint optimization. Experiments show that our model achieves significant performance improvements.
Keywords
bidirectional association, co-generation, conversational search
Discipline
Artificial Intelligence and Robotics | Databases and Information Systems
Research Areas
Intelligent Systems and Optimization
Publication
SIGIR '22: Proceedings of the 45th ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, July 11-15
First Page
155
Last Page
164
ISBN
9781450387323
Identifier
10.1145/3477495.3532063
Publisher
ACM
City or Country
New York
Citation
YE, Chenchen; LIAO, Lizi; FENG, Fuli; JI, Wei; and CHUA, Tat-Seng.
Structured and natural responses co-generation for conversational search. (2022). SIGIR '22: Proceedings of the 45th ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, July 11-15. 155-164.
Available at: https://ink.library.smu.edu.sg/sis_research/7223
Copyright Owner and License
Authors
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Additional URL
https://doi.org/10.1145/3477495.3532063