Dense 3D Reconstruction Based on Photometric Stereo with Unknown Light Source via Energy Minimization Framework

Abstract:

In this paper,an novel method would be suggested to achieve an dense 3D reconstruction of objects using photometric stereo without any prior knowledge of light source. Using the photometric images I which is constructed with its columns equal to number of photometric images captured and rows equal to number of pixels in a photometric image. A per pixel initial surface normal estimate is computed based upon SVD of the image matrix I. A effective regularization technique has been applied on the initial normal estimate within the energy minimization framework which via graph cuts to regularize them and preserve the underlying discontinuities better.Finally, the regularized surface normals are integrated to recover the surface of the object. The algorithm has been tested on synthetic as well as real datasets and very encouraging results have been obtained.

• Periodical: Applied Mechanics and Materials (Volumes 427-429)
• Pages: 1776-1780
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.427-429.1776
• Online since: September 2013
• Authors: Yong Yan Yu
• Keywords: Dense 3D Reconstruction, Energy Minimization, Graph Cuts, Photometric Image

References

[1] R.J. Woodham. Photometric method for determining surface orientation from multiple images. Optical Eng., 19(1): 139-144, January (1980).

DOI: 10.1117/12.7972479

[2] K. Ikeuchi. Determining surface orientations of specular surfaces by using the photometric stereo method. In IEEE Transactions on Pattern Analysis and Machine Intelligence, volume 3, pages 661-669, (1981).

DOI: 10.1109/tpami.1981.4767167

[3] E.N. Coleman Jr. and R. Jain. Obtaining 3-dimensional shape of textured and specular surfaces using four-source photometry. Computer Graphics and Image Processing, 18(4): 309-328, (1982).

DOI: 10.1016/0146-664x(82)90001-6

[4] F. Solomon and K. Ikeuchi. Extracting the shape and roughness of specular lobe objects using four light photometric stereo. IEEE Trans. Pattern Analysis and Machine Intelligence, 18(4): 449-454, April (1996).

DOI: 10.1109/34.491627

[5] K.M. Lee and C.C.J. Kuo. Shape reconstruction from photometric stereo. Proc. Conf. Computer Vision and Pattern Recognition, pages 479-484, (1992).

DOI: 10.1109/cvpr.1992.223147

[6] R.J. Woodham. Gradient and curvature from the photometric-stereo method, including local confidence estimation. J. Optical Soc. Am., 11(11): 3050-3068, November (1994).

DOI: 10.1364/josaa.11.003050

[7] T-P Wu, K-L Tang, C-K Tang, and T-T Wong. Dense photometric stereo: A markov random field approach. In IEEE Transactions on Pattern Analysis and Machine Intelligence, volume 28, November (2006).

DOI: 10.1109/tpami.2006.224

[8] Y. Boykov, O. Veksler, and R. Zabih. Fast approximate energy minimization via graph cuts. In IEEE Transactions on Pattern Analysis, volume 23, pages 1222-1239, (2001).

DOI: 10.1109/34.969114