Publication Type
Conference Proceeding Article
Version
acceptedVersion
Publication Date
11-2024
Abstract
Users post numerous product-related questions on e-commerce platforms, affecting their purchase decisions. Product-related question answering (PQA) entails utilizing product-related resources to provide precise responses to users. Wepropose a novel task of Multilingual Crossmarket Product-based Question Answering (MCPQA) and define the task as providing answers to product-related questions in a main marketplace by utilizing information from another resource-rich auxiliary marketplace in a multilingual context. We introduce a largescale dataset comprising over 7 million questions from 17 marketplaces across 11 languages. We then perform automatic translation on the Electronics category of our dataset, naming it as McMarket. We focus on two subtasks: review-based answer generation and productrelated question ranking. For each subtask, we label a subset of McMarket using an LLM and further evaluate the quality of the annotations via human assessment. We then conduct experiments to benchmark our dataset, using models ranging from traditional lexical models to LLMsin both single-market and cross-market scenarios across McMarket and the corresponding LLM subset. Results show that incorporating cross-market information significantly enhances performance in both tasks.
Keywords
Large-scale dataset, E-commerce platforms, Large Language Models (LLMs)
Discipline
Databases and Information Systems
Research Areas
Data Science and Engineering
Publication
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, Florida, USA, November 12-16
Publisher
ACL
City or Country
Texas
Citation
YUAN, Yifei; DENG, Yang; SOGAARD, Anders; and ALLIANNEJADI, Mohammad.
Unlocking markets: A multilingual benchmark to cross-market question answering. (2024). Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, Florida, USA, November 12-16.
Available at: https://ink.library.smu.edu.sg/sis_research/9539
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.