Near-Duplicate Keyframe Retrieval by Nonrigid Image Matching
Conference Proceeding Article
Near-duplicate image retrieval plays an important role in many real-world multimedia applications. Most previous approaches have some limitations. For example, conventional appearance-based methods may suffer from the illumination variations and occlusion issue, and local feature correspondence-based methods often do not consider local deformations and the spatial coherence between two point sets. In this paper, we propose a novel and effective Nonrigid Image Matching (NIM) approach to tackle the task of near-duplicate keyframe retrieval from real-world video corpora. In contrast to previous approaches, the NIM technique can recover an explicit mapping between two near-duplicate images with a few deformation parameters and find out the correct correspondences from noisy data effectively. To make our technique applicable to large-scale applications, we suggest an effective multi-level ranking scheme that filters out the irrelevant results in a coarse-to-fine manner. In our ranking scheme, to overcome the extremely small training size challenge, we employ a semi-supervised learning method for improving the performance using unlabeled data. To evaluate the effectiveness of our solution, we have conducted extensive experiments on two benchmark testbeds extracted from the TRECVID2003 and TRECVID2004 corpora. The promising results show that our proposed method is more effective than other state-of-the-art approaches.
Computer Sciences | Databases and Information Systems
Data Management and Analytics
MM '08: Proceedings of the 2008 ACM International Conference on Multimedia, with co-located symposium and workshops: Vancouver, BC, Canada, October 27-31, 2008
City or Country
ZHU, Jianke; HOI, Steven C. H.; LYU, Michael R.; and YAN, Shuicheng.
Near-Duplicate Keyframe Retrieval by Nonrigid Image Matching. (2008). MM '08: Proceedings of the 2008 ACM International Conference on Multimedia, with co-located symposium and workshops: Vancouver, BC, Canada, October 27-31, 2008. 41-50. Research Collection School Of Information Systems.
Available at: http://ink.library.smu.edu.sg/sis_research/2375