Publication Type

Journal Article

Version

publishedVersion

Publication Date

10-2008

Abstract

This paper presents an unified approach in analyzing and Structuring the content of videotaped lectures for distance learning applications. By Structuring lecture videos, we can Support topic indexing and semantic querying of multimedia documents captured in the traditional classrooms. Our goal in this paper is to automatically construct the cross references of lecture videos and textual documents so as to facilitate the synchronized browsing and presentation of multimedia information. The major issues involved in our approach are topical event detection, video text analysis and the matching of slide shots and external documents. In topical event detection, a novel transition detector is proposed to rapidly locate the slide shot boundaries by computing the changes of text and background regions in videos. For each detected topical event, multiple keyframes are extracted for video text detection, super-resolution reconstruction, binarization and recognition. A new approach for the reconstruction of high-resolution textboxes based on linear interpolation and multi-frame integration is also proposed for the effective binarization and recognition. The recognized characters are utilized to match the video slide shots and external documents based on our proposed title and content similarity measures. (C) 2008 Elsevier Ltd. All rights reserved.

Keywords

topic detection, video text analysis, super-resolution reconstruction, synchronization of lecture videos and electronic slides

Discipline

Computer Sciences | Graphics and Human Computer Interfaces

Research Areas

Intelligent Systems and Optimization

Publication

Pattern Recognition

Volume

41

Issue

10

First Page

3257

Last Page

3269

ISSN

0031-3203

Identifier

10.1016/j.patcog.2008.03.024

Publisher

Elsevier

Download

Share

COinS