Research

We have created an office display that combines a projector-camera module with a multi-planar display surface and an LCD screen to display single- and multisurface content as well as focus plus context information. Desktop scanning is also supported via the cameras of the projector-camera module.

Calibration techniques for projector-based displays typically require that the display configuration remain fixed, since they are unable to adapt to changes such as the movement of a projector. In this paper, we present a novel technique for continuous projector calibration that is able to continuously estimate the pose of a single projector by matching features in the projected imagery to a calibrated camera.

Projectors equipped with wide-angle lenses can have an advantage over traditional projectors in creating immersive display environments since they can be placed very close to the display surface while still producing large images. We have developed a new rendering technique that is able to correct for both arbitrary display surface geometry and the extreme lens distortion caused by fisheye lenses.

We have developed a RANSAC-based technique for reconstructing the shape of multi-planar, vertically extruded display surfaces, which are common in indoor environments such as office buildings. We are able to create a geometric model that is less complex than a dense tessellated mesh and offers a simple method for accurately modeling the corners of rooms.

Gaseous phenomena such as clouds, fog, and mist have been difficult to render in realistic monoscopic imaging environments. Such phenomena are transparent, cast shadows, have dynamic behavior, and are of variable density. We show that splatting-based techniques for monoscopic rendering of these phenomena can be adapted for use in efficient, real-time stereo imaging.