Egocentric hand detection via dynamic region growing

Publication Type

Journal Article

Publication Date

1-2018

Abstract

Egocentric videos, which mainly record the activities carried out by the users of wearable cameras, have drawn much research attention in recent years. Due to its lengthy content, a large number of ego-related applications have been developed to abstract the captured videos. As the users are accustomed to interacting with the target objects using their own hands, while their hands usually appear within their visual fields during the interaction, an egocentric hand detection step is involved in tasks like gesture recognition, action recognition, and social interaction understanding. In this work, we propose a dynamic region-growing approach for hand region detection in egocentric videos, by jointly considering hand-related motion and egocentric cues. We first determine seed regions that most likely belong to the hand, by analyzing the motion patterns across successive frames. The hand regions can then be located by extending from the seed regions, according to the scores computed for the adjacent superpixels. These scores are derived from four egocentric cues: contrast, location, position consistency, and appearance continuity. We discuss how to apply the proposed method in real-life scenarios, where multiple hands irregularly appear and disappear from the videos. Experimental results on public datasets show that the proposed method achieves superior performance compared with the state-of-the-art methods, especially in complicated scenarios.

Keywords

Egocentric videos, egocentric hand detection, seed region generation, hand region growing

Discipline

Information Security

Research Areas

Information Systems and Management

Publication

ACM Transactions on Multimedia Computing, Communications and Applications

Volume

14

Issue

1

ISSN

1551-6857

Identifier

10.1145/3152129

Publisher

Association for Computing Machinery (ACM)

Additional URL

https://doi.org/10.1145/3152129

This document is currently not available here.

Share

COinS