Title

What Makes Categories Difficult to Classify?

Publication Type

Conference Proceeding Article

Publication Date

11-2009

Abstract

In this paper, we try to predict which category will be less accurately classified compared with other categories in a classification task that involves multiple categories. The categories with poor predicted performance will be identified before any classifiers are trained and additional steps can be taken to address the predicted poor accuracies of these categories. Inspired by the work on query performance prediction in ad-hoc retrieval, we propose to predict classification performance using two measures, namely, category size and category coherence. Our experiments on 20-Newsgroup and Reuters-21578 datasets show that the Spearman rank correlation coefficient between the predicted rank of classification performance and the expected classification accuracy is as high as 0.9.

Keywords

classification performance prediction, text classification

Discipline

Databases and Information Systems | Numerical Analysis and Scientific Computing

Research Areas

Data Management and Analytics

Publication

ACM Conference on Information and Knowledge Management (CIKM)

First Page

1891

Last Page

1894

ISBN

9781605585123

Identifier

10.1145/1645953.1646258

Publisher

ACM

Additional URL

http://dx.doi.org/10.1145/1645953.1646258