"High dynamic range scanning technique," Opt. Eng., (2009)

[18] S Zhang and S-T Yau, "High dynamic range scanning technique," Opt. Eng. 48(3), 033604, 2009; doi: 10.1117/1.3099720

Measuring objects with a high variation range of surface reflectivity is challenging for any optical method: This paper addresses a high dynamic range scanning technique that can measure this type of object. It takes advantage of one merit of a phase-shifting algorithm: pixel-by-pixel phase retrieval. For each measurement, a sequence of fringe images with different exposures are taken: the brightest ones have good fringe quality in the darkest areas while the darkest ones have good fringe quality in the brightest areas. They are arranged from brighter to darker
i.e., from higher exposure to lower exposure. The final fringe images, used for phase retrieval, are produced pixel-by-pixel by choosing the brightest but unsaturated corresponding pixel from one exposure. A phase-shifting algorithm is employed to compute the phase, which can be further converted to coordinates. Our experiments demonstrate that the proposed technique can successfully measure objects with high dynamic range of surface reflectivity variation. 
 

"Simultaneous three-dimensional geometry and color texture acquisition using a single-chip color camera," Opt. Eng., (2008)

[17] S Zhang and S-T Yau, "Simultaneous three-dimensional geometry and color texture acquisition using a single-chip color camera," Opt. Eng. 47(12), 123604, 2008; doi: 10.1117/1.3046715

A novel technique that uses a single color camera to capture high-resolution three-dimensional
3-D geometry and the perfectly aligned color texture simultaneously is discussed. A projector projects three phase-shifted black-and-white fringe patterns onto the object, and a color camera captures the fringe images reflected by the object. From these three fringe images, both 3-D shape and the color texture are obtained. Moreover, since only three fringe images are required, this proposed technique permits real-time 3-D shape measurement. Experiments are presented to demonstrate the success of this technique. 

"Absolute phase assisted three-dimensional data registration for a dual-camera structured light system," Appl. Opt., (2008)

[16] S Zhang and S-T Yau, "Absolute phase assisted three-dimensional data registration for a dual-camera structured light system,"  Appl. Opt., 47(17), 3134-3142, 2008 (Cover Feature); doi: 10.1364/AO.47.003134

For a three-dimensional shape measurement system with a single projector and multiple cameras, registering patches from different cameras is crucial. Registration usually involves a complicated and timeconsuming procedure. We propose a new method that can robustly match different patches via absolute phase without significantly increasing its cost. For y and z coordinates, the transformations from one camera to the other are approximated as third-order polynomial functions of the absolute phase. The x coordinates involve only translations and scalings. These functions are calibrated and only need to be determined once. Experiments demonstrated that the alignment error is within RMS 0:7 mm. © 2008 Optical Society of America

"Three-dimensional data merging using Holoimage," Opt. Eng., (2008)

[13] S Zhang and S-T Yau, "Three-dimensional data merging using Holoimage," Opt. Eng., 47(3), 033608, 2008 (Cover Feature); doi: 10.1117/1.2898902

Three-dimensional data merging is vital for full-field threedimensional
3D shape measurement. All 3D range data patches, acquired from either different sensors or the same sensor in different viewing angles, have to be merged into a single piece to facilitate future data analysis. A novel method for 3D data merging using Holoimage is proposed. Similar to the 3D shape measurement system using a phaseshifting method, Holoimage is a phase-shifting–based computer synthesized fringe image. The 3D information is retrieved from Holoimage using a phase-shifting method. If two patches of 3D data with overlapping areas are rendered by OpenGL, the overlapping areas are resolved by the graphics pipeline, that is, only the front geometry can be visualized. Therefore, the merging is performed if the front geometry information can be obtained. Holoimage is to obtain the front geometry by projecting the fringe patterns onto the rendered scene. We also demonstrated that each point of the geometry in the overlapping area can be obtained by averaging the corresponding point of the geometries reconstructed from Holoimage for each patch. Moreover, using Holoimage, the texture can also be obtained. Both simulation and experiments demonstrated the success of the proposed method. 

"Three-dimensional shape measurement using a structured light system with dual cameras," Opt. Eng., (2008)

[12] S Zhang and S-T Yau, "Three-dimensional shape measurement using a structured light system with dual cameras," Opt. Eng., 47(1), 013604, 2008; doi: 10.1117/1.2835686

A structured light system for three-dimensional shape measurement with single camera has the shortcoming of camera occlusion. To alleviate this problem, this paper introduces a structured light system with dual cameras for three-dimensional shape measurement. We discuss
1 system description,
2 system calibration,
3 three-dimensional data registration using the iterative closest-point
ICP algorithm, and
4 three-dimensional data merging using holoimage. The principle of the system is introduced, and experiments are presented to verify its performance.

"High-speed three-dimensional shape measurement system using a modified two-plus-one phase-shifting algorithm," Opt. Eng., (2007)

[11] S Zhang and S-T Yau, "High-speed three-dimensional shape measurement system using a modified two-plus-one phase-shifting algorithm," Opt. Eng., 46(11), 113603, 2007; doi:10.1117/1.2802546

This paper describes a high-resolution, real-time, threedimensional shape measurement system using the modified two-plusone phase-shifting algorithm. The data acquisition speed is as high as 60 frames/ s with an image resolution of 640
480 pixels per frame. Experiments demonstrated that the system was able to acquire the dynamic changing objects such as facial geometric shape changes when the subject is speaking, and the modified two-plus-one phase-shifting algorithm can further alleviate the error due to motion. Applications of this system include manufacturing, online inspection, medical imaging, compute vision, and computer graphics. 

"Generic nonsinusoidal phase error correction for three-dimensional shape measurement using a digital video projector," Appl. Opt., (2007)

[9] S Zhang and S-T Yau, "Generic nonsinusoidal phase error correction for three-dimensional shape measurement using a digital video projector," Appl. Opt., 46(1), 36-43, 2007; doi: 10.1364/AO.46.000036

A structured light system using a digital video projector is widely used for 3D shape measurement. However, the nonlinear
of the projector causes the projected fringe patterns to be nonsinusoidal, which results in phase error and therefore measurement error. It has been shown that, by using a small look-up table (LUT), this type of phase error can be reduced significantly for a three-step phase-shifting algorithm. We prove that this algorithm is generic for any phase-shifting algorithm. Moreover, we propose a new LUT generation method by analyzing the captured fringe image of a flat board directly. Experiments show that this error compensation algorithm can reduce the phase error to at least 13 times smaller.

"Multilevel quality-guided phase unwrapping algorithm for real-time 3-D shape reconstruction,"Appl. Opt., (2007)

[8] S Zhang, X Li and S-T Yau, "Multilevel quality-guided phase unwrapping algorithm for real-time 3-D shape reconstruction,"Appl. Opt. 46(1), 50-57, 2007 (Selected for February 5, 2007 issue of The Virtual Journal for Biomedical Optics); doi: 10.1364/AO.46.000050

A multilevel quality-guided phase unwrapping algorithm for real-time 3D shape measurement is presented. The quality map is generated from the gradient of the phase map. Multilevel thresholds are used to unwrap the phase level by level. Within the data points in each level, a fast scan-line algorithm is employed. The processing time of this algorithm is approximately 18.3 ms for an image size of 640
480 pixels in an ordinary computer. We demonstrate that this algorithm can be implemented into our real-time 3D shape measurement system for real-time 3D reconstruction. Experiments show that this algorithm improves the previous scan-line phase unwrapping algorithm significantly although it reduces its processing speed slightly

"GPU-assisted high-resolution, real-time 3-D shape measurement," Opt. Express, (2006)

[6] S Zhang, D Royer and S-T Yau, "GPU-assisted high-resolution, real-time 3-D shape measurement," Opt. Express, 14, 9120-9129, 2006 (Selected for November 13, 2006 issue of The Virtual Journal for Biomedical Optics); doi: 10.1364/OE.14.009120

This paper describes a Graphics Processing Unit (GPU)-assisted real-time three-dimensional shape measurement system. Our experiments demonstrated that the absolute coordinates calculation and rendering speed of a GPU is more than four times faster than that of a dual CPU workstation with the same graphics card. By implementing the GPU into our system, we realized simultaneous absolute coordinate acquisition, reconstruction and display at 30 frames per second with a resolution of approximately 266K points per frame. Moreover, a 2+1 phase-shifting algorithm was employed to alleviate the measurement error caused by motion. Applications of the system include medical imaging, manufacturing, entertainment, and security.

"High-resolution, real-time 3-D absolute coordinate measurement based on a phase-shifting method,"Opt. Express, (2006)

[5] S Zhang and S-T Yau, "High-resolution, real-time 3-D absolute coordinate measurement based on a phase-shifting method,"Opt. Express, 14, 2644-2649, 2006 ; doi: 10.1364/OE.14.002644

We describe a high-resolution, real-time 3D absolute coordinate measurement system based on a phase-shifting method. It acquires 3D shape at 30 frames per second (fps), with 266K points per frame. A tiny marker is encoded in the projected fringe pattern, and detected by software from the texture image and the gamma map. Absolute 3D coordinates are obtained from the detected marker position and the calibrated system parameters. To demonstrate the performance of the system, we measure a hand moving over a depth distance of approximately 700 mm, and human faces with expressions. Applications of such a system include manufacturing, inspection, entertainment, security, medical imaging.