An adaptive 3D reconstruction method for asymmetric dual-angle multispectral stereo imaging system on UAV platform

作     者：Chen WANG Xian LI Yanfeng GU Zixu WANG 

作者机构：School of Electronics and Information Engineering Harbin Institute of Technology Beijing Institute of Control and Electronic Technology 

出 版 物：《Science China(Information Sciences)》 (中国科学:信息科学(英文版))

年 卷 期：2024年第67卷第8期

页      面：285-299页

核心收录：

学科分类：08[工学] 080203[工学-机械设计及理论] 082503[工学-航空宇航制造工程] 0802[工学-机械工程] 0825[工学-航空宇航科学与技术] 

基　　金：supported by National Science Fund for Outstanding Young Scholars (Grant No. 62025107) Open Fund Project of Kui Yuan Laboratory (Grant No. KY202423) 

主　　题：multispectral images 3D reconstruction stereo imaging system unmanned aerial vehicle feature extraction 

摘      要：A multispectral imaging system often cannot capture 3D spatial information owing to hardware limitations, which diminishes the effectiveness across various domains. To address this problem, we have developed a multispectral stereo imaging system along with an adaptive 3D reconstruction algorithm. Unlike existing unmanned aerial vehicle stereo imaging systems, our multispectral stereo imaging system uses two multispectral cameras with asymmetric spectral bands positioned at different angles. This design enables the acquisition of a higher number of bands and lateral spatial information while maintaining a lightweight structure. This system introduces challenges such as large geometric distortions and intensity differences between multiple bands. To accurately recover 3D spatial information, we propose an adaptive 3D reconstruction method. This method employs a position and orientation system-assisted projection transformation and a normalized threshold adjustment strategy. Finally, mutual information is used to reconstruct the multispectral images densely, effectively addressing nonlinear differences and generating a comprehensive multispectral point cloud. Our stereo system was used for two real data collections in different regions, and the efficacy of the proposed 3D reconstruction method was validated by comparing it with existing methods and commercial software.