Publication Type

Conference Proceeding Article

Version

publishedVersion

Publication Date

12-2011

Abstract

With the rapid growth of social media, there are plenty of information sources freely available online for use. Nevertheless, how to synchronize and leverage these diverse forms of information for multimedia applications remains a problem yet to be seriously studied. This paper investigates the synchronization of multiple media content in the physical form of hyperlinking them. The ultimate goal is to develop browsing systems that author search results with rich media information mined from various knowledge sources. The authoring enables the vivid visualization and exploration of different information landscapes inherent in search results. Several key techniques are studied in this paper for developing these browsing features. These techniques include content mining and selection from web videos, space-time alignment of multiple media, and augmenting of search result with when and what information. We conduct both quantitative and user studies on a large video dataset for performance evaluation. Comparison with traditional techniques including storyboard summarization and video skimming are also presented.

Keywords

Event extraction, Media content synchronization, Video browsing, Visual summarization

Discipline

Data Storage Systems | Graphics and Human Computer Interfaces

Research Areas

Intelligent Systems and Optimization

Publication

Proceedings of the 19th ACM International Conference on Multimedia ACM Multimedia 2011, MM'11, Scottsdale, Arizona, November 28 - December 1

First Page

243

Last Page

252

ISBN

9781450306164

Identifier

10.1145/2072298.2072331

Publisher

ACM

City or Country

Scottsdale, Arizona

Download

Share

COinS