Phase Completion for Fringe Projection Profiler Based on Neural Networks
DOI: 10.23977/acss.2022.060305 | Downloads: 20 | Views: 736
Author(s)
Ziyu Yin 1, Junzheng Li 2
Affiliation(s)
1 Department of Game, Software Engineering Institute of Guangzhou, Guangzhou, China
2 School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China
Corresponding Author
Ziyu YinABSTRACT
Fringe projection profiler (FPP) measures the geometry of the target surface by projecting the pre-modulated stripe map onto the surface, and then capture the phase map with a camera. However, the inaccurate exposure or the characteristics of the surface reflectance may influence the imaging quality of the phase map, leaving some over-exposure and under-exposure regions. Addressing to this problem, this paper propose to apply a neural network to complete the phase map. Firstly, we propose a synthetic dataset to simulate the phase map of the inaccurate exposure regions, based on a physical rendering model. After that, we implement a transformer neural network to complete the missing phase information. Experiments show that the proposed neural network can complete the missing information from its neighbouring information, and provide precise completion results.
KEYWORDS
fringe projection profiler (FPP), physical rendering, neural network, optical measurementCITE THIS PAPER
Ziyu Yin, Junzheng Li, Phase Completion for Fringe Projection Profiler Based on Neural Networks . Advances in Computer, Signals and Systems (2022) Vol. 6: 35-42. DOI: http://dx.doi.org/10.23977/acss.2022.060305.
REFERENCES
[1] X. J. Jiang and D. J. Whitehouse, "Technological shifts in surface metrology," CIRP annals, vol. 61, no. 2, pp. 815–836, 2012.
[2] Y. Hu, Q. Chen, S. Feng, and C. Zuo, "Microscopic fringe projection profilometry: A review," Optics and Lasers in Engineering, p. 106192, 2020.
[3] H. Jiang, H. Zhao, and X. Li, "High dynamic range fringe acquisition: a novel 3-d scanning technique for high-reflective surfaces," Optics and Lasers in Engineering, vol. 50, no. 10, pp. 1484–1493, 2012.
[4] S. Tang and F. Gu, "Adaptive microphase measuring profilometry for three-dimensional shape reconstruction of a shiny surface," Optical Engineering, vol. 59, no. 1, p. 014104, 2020.
[5] C. J. Waddington and J. D. Kofman, "Modified sinusoidal fringe-pattern projection for variable illuminance in phase-shifting three-dimensional surface-shape metrology," Optical Engineering, vol. 53, no. 8, p. 084109, 2014.
[6] L. Zhang, Q. Chen, C. Zuo, and S. Feng, "High dynamic range 3d shape measurement based on the intensity response function of a camera," Applied optics, vol. 57, no. 6, pp. 1378–1386, 2018.
[7] Y. LeCun, Y. Bengio, and G. Hinton, "Deep learning," nature, vol. 521, no. 7553, pp. 436–444, 2015.
[8] J. Xie, L. Xu, and E. Chen, "Image denoising and inpainting with deep neural networks," Advances in neural information processing systems, vol. 25, 2012.
[9] W. Li, Z. Lin, K. Zhou, L. Qi, Y. Wang, and J. Jia, "Mat: Mask-aware transformer for large hole image inpainting," arXiv preprint arXiv:2203.15270, 2022.
[10] D. Li and J. Kofman, "Adaptive fringe-pattern projection for image saturation avoidance in 3d surface-shape measurement," Optics express, vol. 22, no. 8, pp. 9887–9901, 2014.
[11] C. Ballester, M. Bertalmio, V. Caselles, G. Sapiro, and J. Verdera, "Filling-in by joint interpolation of vector fields and gray levels," IEEE transactions on image processing, vol. 10, no. 8, pp. 1200–1211, 2001.
[12] D. Pathak, P. Krahenbuhl, J. Donahue, T. Darrell, and A. A. Efros, "Context encoders: Feature learning by inpainting," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 2536–2544.
[13] J. Yu, Z. Lin, J. Yang, X. Shen, X. Lu, and T. S. Huang, "Generative image inpainting with contextual attention," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 5505–5514.
[14] G. Liu, F. A. Reda, K. J. Shih, T.-C. Wang, A. Tao, and B. Catanzaro, "Image inpainting for irregular holes using partial convolutions," in Proceedings of the European conference on computer vision (ECCV), 2018, pp. 85–100.
[15] J. Yu, Z. Lin, J. Yang, X. Shen, X. Lu, and T. S. Huang, "Free-form image inpainting with gated convolution," in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019, pp. 4471–4480.
[16] K. He, X. Chen, S. Xie, Y. Li, P. Dollar, and R. Girshick, "Masked autoencoders are scalable vision learners," in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 16000–16009.
Downloads: | 16035 |
---|---|
Visits: | 271429 |
Sponsors, Associates, and Links
-
Power Systems Computation
-
Internet of Things (IoT) and Engineering Applications
-
Computing, Performance and Communication Systems
-
Journal of Artificial Intelligence Practice
-
Journal of Network Computing and Applications
-
Journal of Web Systems and Applications
-
Journal of Electrotechnology, Electrical Engineering and Management
-
Journal of Wireless Sensors and Sensor Networks
-
Journal of Image Processing Theory and Applications
-
Mobile Computing and Networking
-
Vehicle Power and Propulsion
-
Frontiers in Computer Vision and Pattern Recognition
-
Knowledge Discovery and Data Mining Letters
-
Big Data Analysis and Cloud Computing
-
Electrical Insulation and Dielectrics
-
Crypto and Information Security
-
Journal of Neural Information Processing
-
Collaborative and Social Computing
-
International Journal of Network and Communication Technology
-
File and Storage Technologies
-
Frontiers in Genetic and Evolutionary Computation
-
Optical Network Design and Modeling
-
Journal of Virtual Reality and Artificial Intelligence
-
Natural Language Processing and Speech Recognition
-
Journal of High-Voltage
-
Programming Languages and Operating Systems
-
Visual Communications and Image Processing
-
Journal of Systems Analysis and Integration
-
Knowledge Representation and Automated Reasoning
-
Review of Information Display Techniques
-
Data and Knowledge Engineering
-
Journal of Database Systems
-
Journal of Cluster and Grid Computing
-
Cloud and Service-Oriented Computing
-
Journal of Networking, Architecture and Storage
-
Journal of Software Engineering and Metrics
-
Visualization Techniques
-
Journal of Parallel and Distributed Processing
-
Journal of Modeling, Analysis and Simulation
-
Journal of Privacy, Trust and Security
-
Journal of Cognitive Informatics and Cognitive Computing
-
Lecture Notes on Wireless Networks and Communications
-
International Journal of Computer and Communications Security
-
Journal of Multimedia Techniques
-
Automation and Machine Learning
-
Computational Linguistics Letters
-
Journal of Computer Architecture and Design
-
Journal of Ubiquitous and Future Networks