Publication Type
Conference Proceeding Article
Version
publishedVersion
Publication Date
9-2021
Abstract
Although Sentiment Analysis (SA) is widely applied in many domains, existing research has revealed that the unfairness in SA systems can be harmful to the welfare of less privileged people. Several works propose pre-processing and in-processing methods to eliminate bias in SA systems, but little attention is paid to utilizing post-processing methods to heal bias. Postprocessing methods are particularly important for systems that use third-party SA services. Systems that use such services have no access to the SA engine or its training data and thus cannot apply pre-processing nor in-processing methods. Therefore, this paper proposes a black-box post-processing method to make an SA system heal bias and construct fair results when bias is detected. We propose and investigate six self-healing strategies. Our evaluation results on two datasets show that the best strategy can construct fair results and improve accuracy on the two datasets by 2.76% and 2.85%, respectively. To the best of our knowledge, our work is the first self-healing method that can be deployed to ensure SA fairness without requiring access to the SA engine or its training data.
Keywords
Software Fairness, Sentiment Analysis, Bias Healing
Discipline
Databases and Information Systems | Software Engineering
Research Areas
Data Science and Engineering
Publication
Proceedings of the 37th IEEE International Conference on Software Maintenance and Evolution (ICSME 2021), Luxembourg, September 27 - October 1
First Page
644
Last Page
648
Identifier
10.1109/ICSME52107.2021.00073
Publisher
IEEE
City or Country
Luxembourg
Citation
YANG, Zhou; JAIN, Harshit; SHI, Jieke; ASYROFI, Muhammad Hilmi; and LO, David.
BiasHeal: On-the-fly black-box healing of bias in sentiment analysis systems. (2021). Proceedings of the 37th IEEE International Conference on Software Maintenance and Evolution (ICSME 2021), Luxembourg, September 27 - October 1. 644-648.
Available at: https://ink.library.smu.edu.sg/sis_research/6711
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.