Rapid tracking of extrinsic projector parameters in fringe projection using machine learning

Stavroulakis, Petros; Chen, Shuxiao; Delorme, Clement; Bointon, Patrick; Tzimiropoulos, Georgios; Leach, Richard

Abstract

In this work, we propose to enable the angular re-orientation of a projector within a fringe projection system in real-time without the need for re-calibrating the system. The estimation of the extrinsic orientation parameters of the projector is performed using a convolutional neural network and images acquired from the camera in the setup. The convolutional neural network was trained to classify the azimuth and elevation angles of the projector approximated by a point source through shadow images of the measured object. The images used to train the neural network were generated through the use of CAD rendering, by simulating the illumination of the object model from different directions and then rendering an image of its shadow. The accuracy to which the azimuth and elevation angles are estimated is within 1 classification bin, where 1 bin is designated as a ±10° patch of the illumination dome. To evaluate use of the proposed system in fringe projection, a pyramidal additively manufactured object was measured. The point clouds generated using the proposed method were compared to those obtained by an established fringe projection calibration method. The maximum dimensional error in the point cloud generated when using the convolutional network as compared to the established calibration method for the object measured was found to be 1.05 mm on average.

Citation

Stavroulakis, P., Chen, S., Delorme, C., Bointon, P., Tzimiropoulos, G., & Leach, R. (2019). Rapid tracking of extrinsic projector parameters in fringe projection using machine learning. Optics and Lasers in Engineering, 114, 7-14. https://doi.org/10.1016/j.optlaseng.2018.08.018

• Journal Article Type: Article
• Acceptance Date: Aug 28, 2018
• Online Publication Date: Oct 25, 2018
• Publication Date: 2019-03
• Deposit Date: Oct 26, 2018
• Publicly Available Date: Oct 26, 2018
• Journal: Optics and Lasers in Engineering
• Print ISSN: 0143-8166
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 114
• Pages: 7-14
• DOI: https://doi.org/10.1016/j.optlaseng.2018.08.018
• Keywords: Mechanical Engineering; Electrical and Electronic Engineering; Atomic and Molecular Physics, and Optics; Electronic, Optical and Magnetic Materials
• Public URL: https://nottingham-repository.worktribe.com/output/1192704
• Publisher URL: https://www.sciencedirect.com/science/article/pii/S0143816618304809