Context-Awareness Network with Multi-Level Feature Fusion for Building Change Detection

Abstract:

Building change detection is critical for urban management. Deep learning methods are more discriminatory and learnable than traditional change detection methods. But in complicated backdrop environments, it is still difficult to precisely pinpoint change zones of interest. Most change detection networks suffer from inaccurate feature characterization during feature extraction and fusion. As a solution to these problems, we propose the use of multilevel feature fusion in conjunction with aware networks to detect building changes. To obtain multi-scale change characteristics, our Context-awareness network employs multi-scale patch embedding. Followed by multi-path Transformers to enhance learning and extract more suitable features. The multi-scale fusion module can ensure semantic consistency of change features, making detected change regions more accurate. Visual comparisons and quantitative evaluations of our method showed that it outperformed seven popular change detection methods on the LEVIR-CD dataset.

• Periodical: Advances in Science and Technology (Volume 144)
• Pages: 71-78
• DOI: https://doi.org/10.4028/p-rgoW4x
• Online since: March 2024
• Authors: Hao Nan Yu, Juan Du, Zhao Yi Ye, Li Ye Mei, Sheng Yu Huang, Wei Yang, Chuan Xu*
• Keywords: Building Change Detection, Context-Awareness, Deep Learning, Multi-Level Fusion, Multi-Scale Patch-Embedding

References

[1] Y. Afaq and A. Manocha, Analysis on change detection techniques for remote sensing applications: A review, Ecological Informatics, 63 (2021)101310.

DOI: 10.1016/j.ecoinf.2021.101310

[2] A. H. Chughtai, H. Abbasi, and I. R. Karas, "A review on change detection method and accuracy assessment for land use land cover," Remote Sensing Applications: Society and Environment, 22 (2021) 100482.

DOI: 10.1016/j.rsase.2021.100482

[3] S. Ghaffarian, J. Valente, M. Van Der Voort, and B. Tekinerdogan, "Effect of attention mechanism in deep learning-based remote sensing image processing: A systematic literature review," Remote Sensing, 13.15 (2021) 2965.

DOI: 10.3390/rs13152965

[4] A. Mohan, A. K. Singh, B. Kumar, and R. Dwivedi, "Review on remote sensing methods for landslide detection using machine and deep learning," Transactions on Emerging Telecommunications Technologies, 32.7 (2021) e3998.

DOI: 10.1002/ett.3998

[5] A. Goswami et al., "Change detection in remote sensing image data comparing algebraic and machine learning methods," Electronics, 11. 3(2022) 431.

DOI: 10.3390/electronics11030431

[6] M. Hussain, D. Chen, A. Cheng, H. Wei, and D. Stanley, "Change detection from remotely sensed images: From pixel-based to object-based approaches," ISPRS Journal of photogrammetry and remote sensing, 80 (2013) 91-106.

DOI: 10.1016/j.isprsjprs.2013.03.006

[7] X. Zhang, L. Wang, and L. Jiao, "An unsupervised change detection based on clustering combined with multiscale and region growing," in 2011 International Workshop on Multi-Platform/Multi-Sensor Remote Sensing and Mapping, (2011): 1-4.

DOI: 10.1109/m2rsm.2011.5697411

[8] P. Arbelaez, M. Maire, C. Fowlkes, and J. Malik, "Contour detection and hierarchical image segmentation," IEEE transactions on pattern analysis and machine intelligence, 33.5 (2010) 898-916.

DOI: 10.1109/TPAMI.2010.161

[9] H. Jiang et al., "A survey on deep learning-based change detection from high-resolution remote sensing images," Remote Sensing,14.7(2022)1552.

DOI: 10.3390/rs14071552

[10] J. Long, E. Shelhamer, and T. Darrell, "Fully convolutional networks for semantic segmentation," in Proceedings of the IEEE conference on computer vision and pattern recognition, (2015) 3431-3440.

DOI: 10.1109/cvpr.2015.7298965

[11] O. Ronneberger, P. Fischer, and T. Brox, "U-net: Convolutional networks for biomedical image segmentation," in Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, (2015), Proceedings, Part III 18, 2015: Springer, pp.234-241.

DOI: 10.1007/978-3-319-24574-4_28

[12] J. Bromley, I. Guyon, Y. LeCun, E. Säckinger, and R. Shah, "Signature verification using a" siamese" time delay neural network," Advances in neural information processing systems, 6, (1993).

DOI: 10.1142/9789812797926_0003

[13] R. C. Daudt, B. Le Saux, and A. Boulch, "Fully convolutional siamese networks for change detection," in 2018 25th IEEE International Conference on Image Processing (ICIP), (2018) 4063-4067.

DOI: 10.1109/icip.2018.8451652

[14] Y. Lee, J. Kim, J. Willette, and S. J. Hwang, Mpvit: Multi-path vision transformer for dense prediction, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, (2022) 7287-7296.

DOI: 10.1109/cvpr52688.2022.00714

[15] P. Isola, J.-Y. Zhu, T. Zhou, and A. A. Efros, Image-to-image translation with conditional adversarial networks, in Proceedings of the IEEE conference on computer vision and pattern recognition, (2017)1125-1134.

DOI: 10.1109/cvpr.2017.632

[16] A. A. Taha and A. Hanbury, "Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool," BMC medical imaging, 15.1(2015):1-28.

DOI: 10.1186/s12880-015-0068-x

[17] H. Chen and Z. Shi, "A spatial-temporal attention-based method and a new dataset for remote sensing image change detection," Remote Sensing, 12.10 (2020) 1662.

DOI: 10.3390/rs12101662

[18] P. F. Alcantarilla, S. Stent, G. Ros, R. Arroyo, and R. Gherardi, Street-view change detection with deconvolutional networks, Autonomous Robots, 42 (2018)1301-1322.

DOI: 10.1007/s10514-018-9734-5

[19] P. Wu and H. Guo, "LuNET: a deep neural network for network intrusion detection," in 2019 IEEE symposium series on computational intelligence (SSCI), (2019) 617-624.

DOI: 10.1109/ssci44817.2019.9003126

[20] C. Zhang et al., A deeply supervised image fusion network for change detection in high resolution bi-temporal remote sensing images, ISPRS Journal of Photogrammetry and Remote Sensing,166(2020)183-200.

DOI: 10.1016/j.isprsjprs.2020.06.003

[21] H. Chen, Z. Qi, and Z. Shi, Remote sensing image change detection with transformers, IEEE Transactions on Geoscience and Remote Sensing,60(2021)1-14.

DOI: 10.1109/TGRS.2021.3095166