研究目的
To propose and implement an FPGA system for extracting vibration components from moving images in real-time, aiming at applications like microsurgery assistance systems for tremor suppression.
研究成果
The proposed FPGA system successfully extracts and filters vibration components in real-time with low latency, demonstrating effectiveness for applications like tremor suppression. Future work includes reducing frame buffer size and integrating into a mechanical feedback system.
研究不足
The system requires a frame buffer for calculating inter-frame differences, which consumes significant BRAM resources. It may not handle very fast motions or complex scenes robustly without parameter tuning.
1:Experimental Design and Method Selection:
The system uses the Lucas-Kanade method for optical flow estimation and the bandlimited multiple Fourier linear combiner (BMFLC) for adaptive filtering, implemented in a deeply pipelined architecture on an FPGA to achieve real-time performance.
2:Sample Selection and Data Sources:
Input images are obtained from an OmniVision Technologies OV9620 CMOS camera, generating 8-bit image data with 640x480 pixels at 60 fps.
3:List of Experimental Equipment and Materials:
FPGA (Xilinx Kintex-7 XC325T on KC-705 evaluation board), camera (OmniVision OV9620), synthesis tool (Xilinx Vivado 2016.4).
4:4).
Experimental Procedures and Operational Workflow:
4. Experimental Procedures and Operational Workflow: Gray-scale images are processed in a pipelined manner: optical flow calculation, averaging, and BMFLC filtering. The system is evaluated with a metronome and hand motions to test vibration extraction and filtering.
5:Data Analysis Methods:
Performance is assessed based on throughput, latency, resource utilization, and empirical results from experiments, comparing with a software implementation.
独家科研数据包,助您复现前沿成果,加速创新突破
获取完整内容