Effective land use classification through hybrid transformer using remote sensing imagery

Authors

Muhammad Zia Ur Rehman, Edith Cowan UniversityFollow
Syed Mohammed Shamsul Islam, Edith Cowan UniversityFollow
Anwaar Ulhaq
David Blake, Edith Cowan UniversityFollow
Naeem Janjua

Author Identifier

Muhammad Zia Ur Rehman: https://orcid.org/0000-0001-9531-1941

Syed Mohammed Shamsul Islam: https://orcid.org/0000-0002-3200-2903

David Blake: https://orcid.org/0000-0003-3747-2960

Document Type

Journal Article

Publication Title

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Publisher

IEEE

School

School of Science

RAS ID

77141

Funders

Edith Cowan University

Comments

Rehman, M. Z. U., Islam, S. M. S., UlHaq, A., Blake, D., & Janjua, N. (2024). Effective land use classification through hybrid transformer using remote sensing imagery. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 18, 2252-2268. https://doi.org/10.1109/JSTARS.2024.3494258

Abstract

Recent advances in deep learning for hyperspectral image (HSI) classification have shown exceptional performance in resource management and environmental planning through land use classification. Despite these successes, challenges continue to persist in land use classification due to the complex topology of natural and man-made structures. The uneven distribution of land cover introduces spectral-spatial variability, causing inter- and intra-class similarity. To address this issue, this study adopts a hybrid approach that combines convolutional neural networks (CNNs) and a transformer model. The technique comprises three key components: a spectral-spatial convolutional module (SSCM), a spatial attention module (SAM), and a transformer module. Each component facilitates the others in the process of classification. SSCM is used to extract shallow features with the help of dilated convolutional layers, while the SAM enhances spatial features for further processing. Additionally, a transformer module with a local neighborhood attention mechanism is employed to extract local semantic information. Several experiments conducted on the Indian Pines and Pavia University hyperspectral datasets validate the performance of the proposed technique, demonstrating higher classification accuracy compared to recent methods in the literature. The technique achieves average accuracies of 97.24% and 99.33% on the Indian Pines and Pavia University datasets, respectively, thus demonstrating its effectiveness for land resource management and environmental planning.

DOI

10.1109/JSTARS.2024.3494258

Creative Commons License

This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License.