Building a Large Scale Test Collection for Effective Benchmarking of Mobile Landmark Search
Conference Proceeding Article
Studying and analyzing system performance is one of the fundamental factors for the related technological advancement in image retrieval. In this paper, we report the construction of a large scale test collection for facilitating robust performance evaluation of mobile landmark image search. Totally, the test collection consists of (1) 355,141 images about 128 landmarks in five cities over 3 continents from Flickr; (2) different kinds of textual features for each image, including surrounding text (e.g. tags), contextual data (e.g. geo-location and upload time), and metadata (e.g. uploader and EXIF); and (3) six types of low-level visual features. For the task of landmark image retrieval evaluation, we also conduct a series of baseline experimental studies on the search performance over different visual queries, which represent different views of a landmark.
Databases and Information Systems
Data Management and Analytics
Advances in Multimedia Modeling: 19th International Conference, MMM 2013, Huangshan, China, January 7-9, 2013, Proceedings, Part II
City or Country
CHENG, Zhiyong; REN, Jing; SHEN, Jialie; and MIAO, Haiyan.
Building a Large Scale Test Collection for Effective Benchmarking of Mobile Landmark Search. (2013). Advances in Multimedia Modeling: 19th International Conference, MMM 2013, Huangshan, China, January 7-9, 2013, Proceedings, Part II. 7733, 36-46. Research Collection School Of Information Systems.
Available at: http://ink.library.smu.edu.sg/sis_research/1674