A Framework for Automatically Recovering Object Shape, Reflectance and Light Sources from Calibrated Images

Publication

B. Mercier, D. Meneveaux and A. Fournier
IJCV
International Journal of Computer Vision, vol. 73, num. 1, pp. 77-93.

Abstract

In this paper, we present a complete framework for recovering an object shape, estimating its reflectance properties and recovering light sources from a set of images. The whole process is performed automatically. We use the shape from silhouette approach proposed by R. Szeliski combined with image pixels for reconstructing a triangular mesh according to the marching cubes algorithm. A classification process identifies regions of the object having the same appearance. For each region, a single point or directional light source is detected. Therefore, we use specular lobes, lambertian regions of the surface or specular highlights seen on images. An identification method jointly (i) decides what light sources are actually significant and (ii) estimates diffuse and specular coefficients for a surface represented by the modified Phong model. In order to validate our algorithm efficiency, we present a case study with various objects, light sources and surface properties. As shown in the results, our system proves accurate even for real objects images obtained with an usual camera and an inexpensive acquisition system.

Keywords

Shape from Silhouette - Marching Cubes - Multiple Light Sources Detection - Reflectance Properties Recovery.

Videos

	Movie 01 - From Acquisition to Relighting
	Movie 02 - Relighting with a moving light source
	Movie 03 - Relighting with a moving light source (with varying color)

Figures

Images

Paper

paper (pdf version)
bibtex
@Article{mercier:hal-00331473,
}