研究目的
To develop a method for reconstructing high-resolution 3D skin surfaces from low-resolution light field images using GAN-based super resolution for haptic palpation in medical diagnosis.
研究成果
The proposed method successfully reconstructs 3D skin surfaces from low-resolution light field images using GAN-based super resolution, showing promise for haptic palpation in medical diagnosis, with potential for improvement in future studies.
研究不足
The current system has limitations in obtaining perfect 3D information; future work includes applying deep learning to light field raw data decoding and using more information for better quality.
1:Experimental Design and Method Selection:
The study uses a light field camera to capture skin images, applies GAN-based super resolution to enhance image quality, computes disparity maps using phase shift and cost functions, and refines the maps with hole filling and weighted median filtering for 3D reconstruction.
2:Sample Selection and Data Sources:
Real-world light field skin images captured with a Lytro camera; training data includes 350,000 images from the ImageNet database.
3:List of Experimental Equipment and Materials:
Lytro 1st generation camera, computer with Intel i7
4:00 GHz CPU, 32 GB RAM, NVIDIA GeForce GTX 1060 3 GB GPU, software:
Python for GAN, Matlab for other algorithms.
5:Experimental Procedures and Operational Workflow:
Decode raw light field data, correct lens distortion, apply GAN super resolution, compute disparity maps using ZSAD and GRAD cost functions with multi-label optimization, perform hole filling and refinement, and use texture mapping for 3D reconstruction.
6:Data Analysis Methods:
Qualitative comparison of super-resolved images and disparity maps, quantitative evaluation using Mean Squared Error (MSE) for disparity maps.
独家科研数据包,助您复现前沿成果,加速创新突破
获取完整内容