Publication Type
Conference Proceeding Article
Version
publishedVersion
Publication Date
10-2009
Abstract
Learning to cope with domain change has been known as a challenging problem in many real-world applications. This paper proposes a novel and efficient approach, named domain adaptive semantic diffusion (DASD), to exploit semantic context while considering the domain-shift-of-context for large scale video concept annotation. Starting with a large set of concept detectors, the proposed DASD refines the initial annotation results using graph diffusion technique, which preserves the consistency and smoothness of the annotation over a semantic graph. Different from the existing graph learning methods which capture relations among data samples, the semantic graph treats concepts as nodes and the concept affinities as the weights of edges. Particularly, the DASD approach is capable of simultaneously improving the annotation results and adapting the concept affinities to new test data. The adaptation provides a means to handle domain change between training and test data, which occurs very often in video annotation task. We conduct extensive experiments to improve annotation results of 374 concepts over 340 hours of videos from TRECVID 2005-2007 data sets. Results show consistent and significant performance gain over various baselines. In addition, the proposed approach is very efficient, completing DASD over 374 concepts within just 2 milliseconds for each video shot on a regular PC.
Discipline
Databases and Information Systems | Graphics and Human Computer Interfaces
Research Areas
Intelligent Systems and Optimization
Publication
Proceedings of the 12th International Conference on Computer Vision, ICCV 2009, Kyoto, Japan, September 29 - October 2
First Page
1420
Last Page
1427
ISBN
9781424444205
Identifier
10.1109/ICCV.2009.5459295
Publisher
IEEE
City or Country
Kyoto, Japan
Citation
JIANG, Yu-Gang; WANG, Jun; CHANG, Shih-Fu; and NGO, Chong-wah.
Domain adaptive semantic diffusion for large scale context-based video annotation. (2009). Proceedings of the 12th International Conference on Computer Vision, ICCV 2009, Kyoto, Japan, September 29 - October 2. 1420-1427.
Available at: https://ink.library.smu.edu.sg/sis_research/6625
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Included in
Databases and Information Systems Commons, Graphics and Human Computer Interfaces Commons