Optimization of image mosaic in weak texture scene by region localization and geometric enhancement strategy
DOI:
https://doi.org/10.4108/eetsis.14495Keywords:
Weak texture, SIFT algorithm, Feature point matches, Feature point expansion, Image registration, Image fusionAbstract
INTRODUCTION: In industrial production and equipment manufacturing, there's a strong practical need to create wide-angle panoramic images through image stitching for comprehensive visual monitoring, but actually deploying it still comes with challenges. However, traditional SIFT-based image registration methods often struggle in low-texture scenes because the feature points are sparse and unevenly distributed, which can easily cause mismatches in non-overlapping areas and lead to registration errors or failures.
OBJECTIVES: This article introduces a new image stitching framework based on SIFT, aimed at improving the quality and accuracy of image stitching in low-texture scenes.
METHODS: We first use a template matching method based on normalized cross-correlation to locate overlapping areas between images, which helps effectively reduce the interference from non-overlapping features and improves the reliability of feature extraction and matching. When the overlapping area mostly consists of weak texture regions, we add a feature matching simulation that uses successfully matched key points to extend extra geometric constraints in the overlap to better link the images.
RESULTS: The experimental results show that the proposed method performs well when stitching images with large areas of weak textures, significantly improving both registration accuracy and overall stitching quality.
CONCLUSION: The proposed method has been initially tested in several challenging scenarios like low light, strong backlighting, and infrared, showing its potential for robust image stitching in low-texture environments.
References
[1] Pautrat R, Barath D, Larsson V, Oswald MR, Pollefeys M, Yu JY. GlueStick: Robust image matching by sticking points and lines together. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV). 2023. p. 9672-9682.
[2] Yang X, Yin Y, Xu H, Jing Q, Jiang Z, Liao T. Advancements of image and video stitching techniques: A review. IEEE Sens J. 2025;25(13):23526-23551. doi: 10.1109/JSEN.2025.3563082.
[3] Choi J, Lim H, Yun S, Shin M, Paik J. Image stitching method for surround view image without seamline. In: Proceedings of the International Conference on Electronics, Information, and Communication (ICEIC). Singapore; 2023 Feb. p. 1-4. doi: 10.1109/ICEIC57457.2023.10049955.
[4] Szeliski R. Video mosaics for virtual environments. IEEE Comput Graph Appl. 1996;16(2):22-30.
[5] Lyu W, Zhou Z, Chen L, Zhou Y. A survey on image and video stitching. Virtual Real Intell Hardw. 2019;1(1):55-83.
[6] Chen C, Lin K, Chen J, Li H, He Y. Seamless-through-breaking: Rethinking image stitching for optimal alignment. In: Proceedings of the Asian Conference on Computer Vision (ACCV). 2024. p. 455-469.
[7] Yu J, He Y, Zhang F, et al. An infrared image stitching method for wind turbine blade using UAV flight data and U-Net. IEEE Sens J. 2023;23(8):8727-8736.
[8] Huang Z, Wan X, Pan D, Ling X, Ling Z, Liang L, Li Y, Zhang Y. Robust feature matching with spatial smoothness constraints. Remote Sens. 2020;12(19):3158.
[9] Li Z, Wu D, Xu W, Wu Q, Yang G, Zhou D. Feature point matching method of weak texture environment in farmland based on improved GMS-PROSAC fusion algorithm. IEEE Access. 2025;13:4158-4169.
[10] Jiang SH, Lu Y, Li H, Hartley R. Learning optical flow from a few matches. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2021. p. 16587-16595.
[11] Subramanyam V, Kumar J, Singh SN. A hybrid descriptor for low-textural image stitching in real-time surface inspection systems. Multimed Tools Appl. 2024;83:20653-20675.
[12] Su K, Zhu M, Li C. Research and application of image stitching algorithm for industrial inspection based on RANSAC+SIFT. In: Proceedings of the 2026 IEEE 8th International Conference on Communications, Information System and Computer Engineering (CISCE); 2026 Mar 27-29; Guangzhou, China. IEEE; 2026. p. 523-527.
[13] Lowe DG. Distinctive image features from scale-invariant keypoints. Int J Comput Vis. 2004;60(2):91-110.
[14] Barnea I, Silverman HF. A class of algorithms for fast digital image registration. IEEE Trans Comput. 1972;C-21(2):179-186.
[15] Sun M, Xiao J, Lim EG, Zhang B, Zhao Y. Fast template matching and update for video object tracking and segmentation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2020. p. 10792-10799.
[16] Arya S, Mount DM, Netanyahu NS, Silverman R, Wu AY. An optimal algorithm for approximate nearest neighbor searching. J ACM. 1998;45(6):891-923.
[17] Fischler MA, Bolles RC. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM. 1981;24(6):381-395.
[18] Ni K, Li Y, Ke C, Zhang Z, Cao W, Yang SX. A fast unsupervised image stitching model based on homography estimation. IEEE Sens J. 2024;24(18):29452-29467.
[19] Tang Z, Zhang Z, Feng J, Chen W, Zhu K, Yang W, Han W. A fast image stitching algorithm based on texture classification and improved SIFT. IEEE Access. 2024;12:124183-124191.
[20] Li A, Guo J, Guo Y. Image stitching based on semantic planar region consensus. IEEE Trans Image Process. 2021;30:5545-5558.
[21] Haralick RM, Sternberg SR, Zhuang X. Image analysis using mathematical morphology. IEEE Trans Pattern Anal Mach Intell. 1987;PAMI-9(4):532-550.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Guohua Xing, Jian Liu, Beibei Fu, Qingyong Yang
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
This is an open access article distributed under the terms of the CC BY-NC-SA 4.0, which permits copying, redistributing, remixing, transformation, and building upon the material in any medium so long as the original work is properly cited.
