Publication Type

Journal Article

Version

publishedVersion

Publication Date

12-2016

Abstract

Automatically identifying characters in movies has attracted researchers' interest and led to several significant and interesting applications. However, due to the vast variation in character appearance as well as the weakness and ambiguity of available annotation, it is still a challenging problem. In this paper, we investigate this problem with the supervision of actor-character name correspondence provided by the movie cast. Our proposed framework, namely, Cast2Face, is featured by: 1) we restrict the assigned names within the set of character names in the cast; 2) for each character, by using the corresponding actor and movie name as keywords, we retrieve from the Google image search and get a group of face images to form the gallery set; 3) the probe face tracks in the movie are then identified as one of the actors by a robust kernel multitask joint sparse representation and classification method; and 4) the conditional random field model with consideration of the constraints between face tracks is introduced to enhance the final labeling. Finally, the assigned actor name of a face track is then mapped to the character name based on the cast again. Besides face naming, we further apply the proposed method to spotlight the summarization of a particular actor in his/her movies. We conduct extensive experiments and empirical evaluations on several feature-length movies to demonstrate the satisfying performance of our method.

Keywords

Cast analysis, character identification, conditional random field (CRF), face recognition, multitask learning

Discipline

Computer Sciences | Databases and Information Systems | Graphics and Human Computer Interfaces

Publication

IEEE Transactions on Circuits and Systems for Video Technology

Volume

26

Issue

12

First Page

2299

Last Page

2312

ISSN

1051-8215

Identifier

10.1109/TCSVT.2015.2504738

Publisher

Institute of Electrical and Electronics Engineers (IEEE)

Additional URL

http://doi.org/10.1109/TCSVT.2015.2504738

Download

Share

COinS