Indoor scene texturing based on single mobile phone images and 3D model fusion

作     者：Hanjiang Xiong Wei Ma Xianwei Zheng Jianya Gong Douadi Abdelalim 

作者机构：State Key Laboratory of Information Engineering in SurveyingMapping and Remote Sensing(LIESMARS)Wuhan UniversityWuhanHubei ProvincePeople’s Republic of China Collaborative Innovation Center of Geospatial TechnologyWuhan UniversityWuhanPeople’s Republic of China 

出 版 物：《International Journal of Digital Earth》 (国际数字地球学报（英文）)

年 卷 期：2019年第12卷第5期

页      面：525-543页

核心收录：

学科分类：08[工学] 080502[工学-材料学] 0805[工学-材料科学与工程（可授工学、理学学位）] 

基　　金：supported by the National Key Research and Development Program of China[grant number 2016YFB0502203] the National Natural Science Foundation of China Project The State Key Laboratory of Information Engineering in Surveying,Mapping and Remote Sensing of Wuhan University 

主　　题：Mobile phone image FCN texture updating indoor 3-D model augmented reality 

摘      要：Realistic texture mapping and coherent up-to-date rendering is one of the most important issues in indoor 3-D ***,existing texturing approaches are usually performed manually during the modelling process,and cannot accommodate changes in indoor environments occurring after the model was created,resulting in outdated and misleading texture *** this study,a structured learning-based texture mapping method is proposed for automatic mapping a single still photo from a mobile phone onto an alreadyconstructed indoor 3-D *** up-to-date texture is captured using a smart phone,and the indoor structural layout is extracted by incorporating per-pixel segmentation in the FCN algorithm and the line constraints into a structured learning *** enables real-time texture mapping according to parts of the model,based on the structural ***,the rough camera pose is estimated by pedestrian dead reckoning(PDR)and map information to determine where to map the *** experimental results presented in this paper demonstrate that our approach can achieve accurate fusion of 3-D triangular meshes with 2-D single images,achieving low-cost and automatic indoor texture *** on this fusion approach,users can have a better experience in virtual indoor3-D applications.