A lightweight state space model with multiscale morphology and low-rank head for hyperspectral image classification

Publication Type

Journal Article

Publication Date

4-2026

Abstract

State space models (SSMs) have advanced hyperspectral image (HSI) classification, yet existing approaches have limitations. They typically rely on single-scale feature extractors, limiting their ability to model various spatial geometries, and their standard backbones can exhibit training instability when processing complex HSI data. To overcome these challenges, this paper proposes a novel lightweight multiscale morphology-enhanced low-rank head residual state space network (MMLH-RSSN), built on a synergistic framework developed for robust feature representation and efficient modeling. Specifically, we first designed a multiscale morphological module to explicitly capture hierarchical spatial features, a crucial step for distinguishing spectrally similar classes with varying scales. To effectively encode these complex features, we then introduced an enhanced Residual SSM, which integrates residual connections and layer normalization to significantly improve model stability and learning capacity. An end-to-end lightweight design was ensured by a parameter-efficient low-rank decomposition head. Extensive experiments on four benchmark datasets show that MMLH-RSSN achieves state-of-the-art performance, with overall accuracies of 98.51% and 99.69% on the Pavia University and Botswana datasets, using only 0.063 M parameters. This work demonstrates that a synergistic combination of multiscale priors and a stabilized SSM backbone offers a highly accurate and efficient solution for HSI classification, particularly for resource-constrained scenarios.

Discipline

Artificial Intelligence and Robotics

Research Areas

Intelligent Systems and Optimization

Publication

Annals of the New York Academy of Sciences

Volume

1558

Issue

1

First Page

1

Last Page

15

ISSN

0077-8923

Identifier

10.1111/nyas.70271

Publisher

Wiley

This document is currently not available here.

Share

COinS