A platform for research: civil engineering, architecture and urbanism
A platform for research: civil engineering, architecture and urbanism
Indoor camera pose estimation via style‐transfer 3D models
Many vision‐based indoor localization methods require tedious and comprehensive pre‐mapping of built environments. This research proposes a mapping‐free approach to estimating indoor camera poses based on a 3D style‐transferred building information model (BIM) and photogrammetry technique. To address the cross‐domain gap between virtual 3D models and real‐life photographs, a CycleGAN model was developed to transform BIM renderings into photorealistic images. A photogrammetry‐based algorithm was developed to estimate camera pose using the visual and spatial information extracted from the style‐transferred BIM. The experiments demonstrated the efficacy of CycleGAN in bridging the cross‐domain gap, which significantly improved performance in terms of image retrieval and feature correspondence detection. With the 3D coordinates retrieved from BIM, the proposed method can achieve near real‐time camera pose estimation with an accuracy of 1.38 m and 10.1° in indoor environments.
Indoor camera pose estimation via style‐transfer 3D models
Many vision‐based indoor localization methods require tedious and comprehensive pre‐mapping of built environments. This research proposes a mapping‐free approach to estimating indoor camera poses based on a 3D style‐transferred building information model (BIM) and photogrammetry technique. To address the cross‐domain gap between virtual 3D models and real‐life photographs, a CycleGAN model was developed to transform BIM renderings into photorealistic images. A photogrammetry‐based algorithm was developed to estimate camera pose using the visual and spatial information extracted from the style‐transferred BIM. The experiments demonstrated the efficacy of CycleGAN in bridging the cross‐domain gap, which significantly improved performance in terms of image retrieval and feature correspondence detection. With the 3D coordinates retrieved from BIM, the proposed method can achieve near real‐time camera pose estimation with an accuracy of 1.38 m and 10.1° in indoor environments.
Indoor camera pose estimation via style‐transfer 3D models
Chen, Junjie (author) / Li, Shuai (author) / Liu, Donghai (author) / Lu, Weisheng (author)
Computer‐Aided Civil and Infrastructure Engineering ; 37 ; 335-353
2022-03-01
19 pages
Article (Journal)
Electronic Resource
English
Adaptive Pose and Location Estimation for Indoor Mobile Robot
| British Library Conference Proceedings | 2003
Precision potential of photogrammetric 6DOF pose estimation with a single camera
| Online Contents | 2009
Precision potential of photogrammetric 6DOF pose estimation with a single camera
| Online Contents | 2009