Publication Type

Journal Article

Version

publishedVersion

Publication Date

10-2024

Abstract

Regional information-based image emotion analysis has recently garnered significant attention. However, existing methods often focus on identifying region proposals through layered steps or merely rely on visual saliency. These approaches may lead to an underestimation of emotional categories and a lack of comprehensive interclass discrimination perception and emotional intraclass contextual mining. To address these limitations, we propose a novel approach named InterIntraIEA, which combines interclass discrimination and intraclass correlation joint learning capabilities for image emotion analysis. The proposed method not only employs category-specific dictionary learning for class adaptation, but also models intraclass contextual relationships and perceives correlations at the channel level. This refinement process improves interclass descriptive ability and enhances emotional categories, resulting in the production of pseudomaps that provide more precise emotional region information. These pseudomaps, in conjunction with top-level features extracted from a multiscale extractor, are then input into a weakly supervised fusion module to predict emotional sentiment categories.

Keywords

Image emotion analysis, Interclass discrimination, Intraclass correlation learning, Weakly supervised learning, Pseudomaps, Contextual relationships

Discipline

Artificial Intelligence and Robotics | Numerical Analysis and Scientific Computing

Research Areas

Data Science and Engineering; Information Systems and Management

Publication

IEEE Intelligent Systems

Volume

39

Issue

5

First Page

82

Last Page

89

ISSN

1541-1672

Identifier

10.1109/MIS.2024.3441408

Publisher

Institute of Electrical and Electronics Engineers

Additional URL

https://doi.org/10.1109/MIS.2024.3441408

Download

Share

COinS