Publication Type

Journal Article

Version

publishedVersion

Publication Date

9-2009

Abstract

Most machine learning tasks in data classification and information retrieval require manually labeled data examples in the training stage. The goal of active learning is to select the most informative examples for manual labeling in these learning tasks. Most of the previous studies in active learning have focused on selecting a single unlabeled example in each iteration. This could be inefficient, since the classification model has to be retrained for every acquired labeled example. It is also inappropriate for the setup of information retrieval tasks where the user's relevance feedback is often provided for the top K retrieved items. In this paper, we present a framework for batch mode active learning, which selects a number of informative examples for manual labeling in each iteration. The key feature of batch mode active learning is to reduce the redundancy among the selected examples such that each example provides unique information for model updating. To this end, we employ the Fisher information matrix as the measurement of model uncertainty, and choose the set of unlabeled examples that can efficiently reduce the Fisher information of the classification model. We apply our batch mode active learning framework to both text categorization and image retrieval. Promising results show that our algorithms are significantly more effective than the active learning approaches that select unlabeled examples based only on their informativeness for the classification model.

Keywords

Batch mode active learning, convex optimization, image retrieval, kernel logistic regressions, logistic regressions, text categorization

Discipline

Databases and Information Systems | Theory and Algorithms

Research Areas

Data Science and Engineering

Publication

IEEE Transactions on Knowledge and Data Engineering (TKDE)

Volume

21

Issue

9

First Page

1233

Last Page

1248

ISSN

1041-4347

Identifier

10.1109/TKDE.2009.60

Publisher

IEEE

Copyright Owner and License

Authors

Additional URL

https://doi.org/10.1109/TKDE.2009.60

Share

COinS