Abstract
Lighting design is often tedious due to the required physical manipulation of real light sources and objects. As an alternative, we present an interactive system to virtually modify the lighting and geometry of scenes with both real and synthetic objects, including mixed real/virtual lighting and shadows.
In our method, real scene geometry is first approximately reconstructed from photographs. Additional images are taken from a single viewpoint with a real light in different positions to estimate reflectance. A filtering process is used to compensate for inaccuracies, and per image reflectances are averaged to generate an approximate reflectance image for the given viewpoint, removing shadows in the process. This estimate is used to initialise a global illumination hierarchical radiosity system, representing real-world secondary illumination; the system is optimized for interactive updates. Direct illumination from lights is calculated separately using ray-casting and a table for efficient reuse of data where appropriate.
Our system allows interactive modification of light emission and object positions, all with mixed real/virtual illumination effects. Real objects can also be virtually removed using texture-filling algorithms for reflectance estimation.
iMAGIS is joint project of CNRS, INPG, INRIA and Université Joseph Fourier.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
D. R. Baum, H. E. Rushmeier, and J. M. Winget. Improving radiosity solutions through the use of analytically determined form-factors. In Computer Graphics (SIGGRAPH’ 89 Proceedings), volume 23, pages 325–334, July 1989.
P.E. Debevec. Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In SIGGRAPH’ 98 Conference Proceedings, Annual Conference Series, pages 189–198, July 1998.
P.E. Debevec and J. Malik. Recovering high dynamic range radiance maps from photographs. In SIGGRAPH’ 97 Conference Proceedings, Annual Conference Series, pages 369–378, August 1997.
P.E. Debevec, C.J. Taylor, and J. Malik. Modeling and rendering architecture from photographs: A hybrid geometry-and image-based approach. In SIGGRAPH’ 96 Conference Proceedings, Annual Conference Series, pages 11–20, July 1996.
G. Drettakis, L. Robert, and S. Bougnoux. Interactive common illumination for computer augmented reality. In Rendering Techniques’ 97 (8th Eurographics Workshop on Rendering), pages 45–56. Springer-Verlag, June 1997.
G. Drettakis and F. Sillion. Interactive update of global illumination using a line-space hierarchy. In SIGGRAPH’ 97 Conference Proceedings, Annual Conference Series, pages 57–64, August 1997.
T. El-Maraghi. An implementation of Heeger and Bergen’s texture analysis/synthesis algorithm with source code. http://www.cs.toronto.edu/~tem/2522/texture.html.
O. Faugeras. Three-Dimensional Computer Vision — A Geometric Viewpoint. MIT Press, 1993.
O. Faugeras, S. Laveau, L. Robert, G. Csurka, and C. Zeller. 3D reconstruction of urban scenes from sequences of images. Tech. report 2572, INRIA Sophia-Antipolis, May 1995.
A. Fournier, A.S. Gunawan, and C. Romanzin. Common illumination between real and computer generated scenes. In Proc. of Graphics Interface’ 93, pages 254–262, May 1993.
E. A. Haines and J. R. Wallace. Shaft Culling for Efficient Ray-Traced Radiosity. In Photorealistic Rendering in Computer Graphics (Proceedings of the 2nd Eurographics Workshop on Rendering), New York, NY, 1994. Springer-Verlag.
P. Hanrahan, D. Salzman, and L. Aupperle. A rapid hierarchical radiosity algorithm. In Computer Graphics (SIGGRAPH’ 91 Proceedings), volume 25, pages 197–206, July 1991.
D.J. Heeger and J.R. Bergen. Pyramid-Based texture analysis/synthesis. In SIGGRAPH’ 95 Conference Proceedings, Annual Conference Series, pages 229–238, August 1995.
H. Igehy and L. Pereira. Image replacement through texture synthesis. In Proceedings of the 1997 IEEE International Conference on Image Processing, 1997.
F. Leymarie, A. de la Fortelle, J. Koenderink, A. Kappers, M. Stavridi, B. van Ginneken, S. Muller, S. Krake, O. Faugeras, L. Robert, C. Gauclin, S. Laveau, and C. Zeller. Realise: Reconstruction of reality from image sequences. In International Conference on Image Processing, volume 3, pages 651–654, Lausanne (Switzerland), 1996. IEEE Signal Proc. Soc.
C. Loscos and G. Drettakis. Interactive relighting of real scenes. Tech. report 0225, INRIA Rhone-Alpes, November 1998.
C. Loscos, G. Drettakis, and L. Robert. Interactive modification of real and virtual lights for augmented reality. In SIGGRAPH’ 98 Technical Sketch (Visual Proceedings), July 1998.
E. Nakamae, K. Harada, T. Ishizaki, and T. Nishita. A montage method: The overlaying of the computer generated images onto a background photograph. In Computer Graphics (SIGGRAPH’ 86 Proceedings), volume 20, pages 207–214, August 1986.
Photomodeler. http://www.photomodeler.com.
P. Poulin, M. Ouimet, and M.-C. Frasson. Interactively modeling with photogrammetry. In Rendering Techniques’ 98 (9th Eurographics Workshop on Rendering), pages 93–104. Springer-Verlag, June 1998.
Y. Sato, M.D. Wheeler, and K. Ikeuchi. Object shape and reflectance modeling from observation. In SIGGRAPH’ 97 Conference Proceedings, Annual Conference Series, pages 379–387, August 1997.
E. Shaw. Hierarchical radiosity for dynamic environments. Computer Graphics Forum, 16(2): 107–118, 1997.
F. X. Sillion. A unified hierarchical algorithm for global illumination with scattering volumes and object clusters. IEEE Transactions on Visualization and Computer Graphics, 1(3):240–254, September 1995.
G.J. Ward. The RADIANCE lighting simulation and rendering system. In Proceedings of SIGGRAPH’ 94, Annual Conference Series, pages 459–472, July 1994.
H. Weghorst, G. Hooper, and D. P. Greenberg. Improved computational methods for ray tracing. ACM Transactions on Graphics, 3(1):52–69, January 1984.
Y. Yu, P.E. Debevec, J. Malik, and T. Hawkins. Inverse global illumination: Recovering reflectance models of real scenes from photographs. In SIGGRAPH’ 99 (to appear), 1999.
Y. Yu and J. Malik. Recovering photometric properties of architectural scenes from photographs. In Computer Graphics (ACM SIGGRAPH’ 98 Proceedings), July 1998.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer-Verlag/Wien
About this paper
Cite this paper
Loscos, C., Frasson, MC., Drettakis, G., Walter, B., Granier, X., Poulin, P. (1999). Interactive Virtual Relighting and Remodeling of Real Scenes. In: Lischinski, D., Larson, G.W. (eds) Rendering Techniques’ 99. EGSR 1999. Eurographics. Springer, Vienna. https://doi.org/10.1007/978-3-7091-6809-7_29
Download citation
DOI: https://doi.org/10.1007/978-3-7091-6809-7_29
Published:
Publisher Name: Springer, Vienna
Print ISBN: 978-3-211-83382-7
Online ISBN: 978-3-7091-6809-7
eBook Packages: Springer Book Archive