Xinchen Ye
Personal Homepage
Dense Reconstruction from Monocular SLAM

Dense Reconstruction from Monocular SLAM with Fusion of Sparse Map-Points and CNN-Inferred Depth


Real-time monocular visual SLAM approaches relying on building sparse correspondences between two or multiple views of the scene, are capable of accurately tracking camera pose and inferring structure of the environment. However, these methods have the common problem, i.e., the reconstructed 3D map is extremely sparse. Recently, convolutional neural network (CNN) is widely used for estimating scene depth from monocular color images. As we observe, sparse map-points generated from epipolar geometry are locally accurate, while CNN-inferred depth map contains high-level global context but generates blurry depth boundaries. Therefore, we propose a depth fusion framework to yield a dense monocular reconstruction that fully exploits the sparse depth samples and the CNN-inferred depth. Color key-frames are employed to guide the depth reconstruction process, avoiding smoothing over depth boundaries. Experimental results on benchmark datasets show the robustness and accuracy of our method.

Index Terms— Dense reconstruction, Visual SLAM, Monocular, Sparse map-point, Depth prediction.


Opening soon. The source code is only for the non-commercial use.


[1]  Xiang Ji, Xinchen Ye*, Hongcan Xu, Haojie Li, Dense Reconstruction from Monocular SLAM with Fusion of Sparse Map-Points and CNN-Inferred Depth. IEEE International Conference on Multimedia and Expo, ICME 2018, San Diego, USA. (CCF-B)

Personal information

Associate Professor
Supervisor of Master's Candidates

Main positions:IEEE member, ACM member

Other Post:None


Alma Mater:Dalian University of Technology

Degree:Doctoral Degree

School/Department:School of Software Technology

Discipline:Software Engineering

Business Address:Teaching Building C507, Campus of Development Zone, Dalian, China.


Email :


Open time:..

The Last Update Time:..

Address: No.2 Linggong Road, Ganjingzi District, Dalian City, Liaoning Province, P.R.C., 116024

MOBILE Version