Publication Type
Conference Proceeding Article
Version
acceptedVersion
Publication Date
2-2011
Abstract
With the popularity of various social media applications, massive social images associated with high quality tags have been made available in many social media web sites nowadays. Mining social images on the web has become an emerging important research topic in web search and data mining. In this paper, we propose a machine learning framework for mining social images and investigate its application to automated image tagging. To effectively discover knowledge from social images that are often associated with multimodal contents (including visual images and textual tags), we propose a novel Unified Distance Metric Learning (UDML) scheme, which not only exploits both visual and textual contents of social images, but also effectively unifies both inductive and transductive metric learning techniques in a systematic learning framework. We further develop an efficient stochastic gradient descent algorithm for solving the UDML optimization task and prove the convergence of the algorithm. By applying the proposed technique to the automated image tagging task in our experiments, we demonstrate that our technique is empirically effective and promising for mining social images towards some real applications.
Keywords
distance metric learning, inductive learning, social images, automated image tagging, transductive learning
Discipline
Computer Sciences | Databases and Information Systems | Numerical Analysis and Scientific Computing
Research Areas
Data Science and Engineering
Publication
WSDM '11: Proceedings of the 4th International Conference on Web Search and Data Mining: Hong Kong, China, February 9-12
First Page
197
Last Page
206
ISBN
9781450304931
Identifier
10.1145/1935826.1935865
Publisher
ACM
City or Country
New York
Citation
WU, Pengcheng; HOI, Steven C. H.; ZHAO, Peilin; and HE, Ying.
Mining Social Images with Distance Metric Learning for Automated Image Tagging. (2011). WSDM '11: Proceedings of the 4th International Conference on Web Search and Data Mining: Hong Kong, China, February 9-12. 197-206.
Available at: https://ink.library.smu.edu.sg/sis_research/2352
Copyright Owner and License
Publisher
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Additional URL
https://doi.org/10.1145/1935826.1935865
Included in
Databases and Information Systems Commons, Numerical Analysis and Scientific Computing Commons