Publication Type

Conference Proceeding Article

Version

publishedVersion

Publication Date

7-2007

Abstract

Bag-of-features (BoF) deriving from local keypoints has recently appeared promising for object and scene classification. Whether BoF can naturally survive the challenges such as reliability and scalability of visual classification, nevertheless, remains uncertain due to various implementation choices. In this paper, we evaluate various factors which govern the performance of BoF. The factors include the choices of detector, kernel, vocabulary size and weighting scheme. We offer some practical insights in how to optimize the performance by choosing good keypoint detector and kernel. For the weighting scheme, we propose a novel soft-weighting method to assess the significance of a visual word to an image. We experimentally show that the proposed soft-weighting scheme can consistently offer better performance than other popular weighting methods. On both PASCAL-2005 and TRECVID-2006 datasets, our BoF setting generates competitive performance compared to the state-of-the-art techniques. We also show that the BoF is highly complementary to global features. By incorporating the BoF with color and texture features, an improvement of 50% is reported on TRECVID-2006 dataset.

Keywords

Bag-of-features, Kernel, Keypoint detector, Object categorization, Semantic video retrieval, Soft-weighting

Discipline

Data Storage Systems | Graphics and Human Computer Interfaces

Research Areas

Intelligent Systems and Optimization

Publication

Proceedings of the 6th ACM international conference on Image and video retrieval, CIVR 2007, Amsterdam, July 9 - 11

First Page

494

Last Page

501

ISBN

1595937331

Identifier

10.1145/1282280.1282352

Publisher

ACM

City or Country

Amsterdam

Download

Share

COinS