Publication Type
Journal Article
Version
acceptedVersion
Publication Date
3-2012
Abstract
The emerging trend of social information processing has resulted in Web users’ increased reliance on user-generated content contributed by others for information searching and decision making. Rating scores, a form of user-generated content contributed by reviewers in online rating systems, allow users to leverage others’ opinions in the evaluation of objects. In this article, we focus on the problem of summarizing the rating scores given to an object into an overall score that reflects the object’s quality. We observe that the existing approaches for summarizing scores largely ignores the effect of reviewers exercising different standards in assigning scores. Instead of treating all reviewers as equals, our approach models the leniency of reviewers, which refers to the tendency of a reviewer to assign higher scores than other coreviewers. Our approach is underlined by two insights: (1) The leniency of a reviewer depends not only on how the reviewer rates objects, but also on how other reviewers rate those objects and (2) The leniency of a reviewer and the quality of rated objects are mutually dependent. We develop the leniency-aware quality, or LQ model, which solves leniency and quality simultaneously. We introduce both an exact and a ranked solution to the model. Experiments on real-life and synthetic datasets show that LQ is more effective than comparable approaches. LQ is also shown to perform consistently better under different parameter settings.
Keywords
Rating, Social network mining, Leniency, Quality, Link analysis
Discipline
Databases and Information Systems | Numerical Analysis and Scientific Computing
Publication
ACM Transactions on the Web
Volume
6
Issue
1
First Page
4-1
Last Page
4-27
ISSN
1559-1131
Identifier
10.1145/2109205.2109209
Publisher
ACM
Citation
LAUW, Hady W.; LIM, Ee Peng; and WANG, Ke.
Quality and leniency in online collaborative rating systems. (2012). ACM Transactions on the Web. 6, (1), 4-1-4-27.
Available at: https://ink.library.smu.edu.sg/sis_research/1518
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Additional URL
https://doi.org/10.1145/2109205.2109209
Included in
Databases and Information Systems Commons, Numerical Analysis and Scientific Computing Commons