Image-based modeling and rendering

Instead of considering only the physical model of a solid, IBMR methods usually focus more on light modeling. The fundamental concept behind IBMR is the plenoptic illumination function which is a parametrisation of the light field. The plenoptic function describes the light rays contained in a given volume. It can be represented with seven dimensions: a ray is defined by its position ${\displaystyle (x,y,z)}$, its orientation ${\displaystyle (\theta ,\phi )}$, its wavelength ${\displaystyle (\lambda )}$ and its time ${\displaystyle (t)}$: ${\displaystyle P(x,y,z,\theta ,\phi ,\lambda ,t)}$. IBMR methods try to approximate the plenoptic function to render a novel set of two-dimensional images from another. Given the high dimensionality of this function, practical methods place constraints on the parameters in order to reduce this number (typically to 2 to 4).

• View morphing generates a transition between images
• Panoramic imaging renders panoramas using image mosaics of individual still images
• Lumigraph relies on a dense sampling of a scene
• Space carving generates a 3D model based on a photo-consistency check

• View synthesis
• 3D reconstruction
• Structure from motion