RGBD salient object detection via deep fusion

Publication Type

Journal Article

Publication Date

5-2017

Abstract

Numerous efforts have been made to design various low-level saliency cues for RGBD saliency detection, such as color and depth contrast features as well as background and color compactness priors. However, how these low-level saliency cues interact with each other and how they can be effectively incorporated to generate a master saliency map remain challenging problems. In this paper, we design a new convolutional neural network (CNN) to automatically learn the interaction mechanism for RGBD salient object detection. In contrast to existing works, in which raw image pixels are fed directly to the CNN, the proposed method takes advantage of the knowledge obtained in traditional saliency detection by adopting various flexible and interpretable saliency feature vectors as inputs. This guides the CNN to learn a combination of existing features to predict saliency more effectively, which presents a less complex problem than operating on the pixels directly. We then integrate a superpixel-based Laplacian propagation framework with the trained CNN to extract a spatially consistent saliency map by exploiting the intrinsic structure of the input image. Extensive quantitative and qualitative experimental evaluations on three data sets demonstrate that the proposed method consistently outperforms the state-of-the-art methods.

Keywords

RGBD saliency detection;convolutional neural network;Laplacian propagation

Discipline

Information Security

Research Areas

Information Systems and Management

Publication

IEEE Transactions on Image Processing

Volume

26

Issue

5

First Page

2274

Last Page

2285

ISSN

1057-7149

Identifier

10.1109/TIP.2017.2682981

Publisher

Institute of Electrical and Electronics Engineers

Additional URL

https://doi.org/10.1109/TIP.2017.2682981

This document is currently not available here.

Share

COinS