<p>Sharpness is a critical optical property of automotive cameras, measured by the spatial frequency response (SFR) within the end-of-line (EOL) test after manufacturing. This work presents a method to estimate the blurring kernel of an automotive camera, which could be the first step toward state monitoring of automotive cameras. To achieve this, Principal Component Analysis&#xa0;(PCA) was performed, using synthetic kernels generated by Zemax. The PCA model was built with approximately 1300 base kernels representing spatially variant point spread functions (PSFs). This model generates kernel samples during the estimation process. Synthetic images were created by convolving the synthetic kernels with reference traffic sign images and compared with real-life data captured by an automotive camera. These synthetic data were utilized for algorithm development, and later on, validation was performed on real-life data. The algorithm extracts two <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(45\times 45\)</EquationSource> </InlineEquation> pixels regions of interest (ROIs) containing slanted edges from the blurred image and crops matching ROIs from a reference sharp image. Each candidate kernel was used to blur the reference ROIs, and the resulting SFR was compared with the blurred ROIs’ SFR. Differential evolution optimization minimizes the SFR difference, selecting the kernel that best matches the observed blur. The final kernel was evaluated against the true kernel for accuracy. The structural similarity index measure (SSIM) between the original and estimated blurred ROIs ranges from 0.808 to 0.945. For true vs. estimated kernels, SSIM varies from 0.92 to 0.98. Pearson correlation coefficients range from 0.84 to 0.99, Cosine similarity from 0.86 to 0.99, and mean squared error (MSE) from <InlineEquation ID="IEq2"> <EquationSource Format="TEX">\(1.1 \times {10}^{-5}\)</EquationSource> </InlineEquation> to <InlineEquation ID="IEq3"> <EquationSource Format="TEX">\(8.3 \times {10}^{-5}\)</EquationSource> </InlineEquation>. Validation on real-life camera images showed that the SSIM between the estimated and blurred ROI was &gt;0.82, showing promising accuracy in kernel estimation, which could be used towards in-field monitoring of camera sharpness degradation.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Quantitative Kernel estimation from traffic signs using slanted edge spatial frequency response as a sharpness metric

  • Amit Pandey,
  • Mohd. Zubair Akhtar,
  • Nandana Kappuva Veettil,
  • Bernhard Wunderle,
  • Gordon Elger

摘要

Sharpness is a critical optical property of automotive cameras, measured by the spatial frequency response (SFR) within the end-of-line (EOL) test after manufacturing. This work presents a method to estimate the blurring kernel of an automotive camera, which could be the first step toward state monitoring of automotive cameras. To achieve this, Principal Component Analysis (PCA) was performed, using synthetic kernels generated by Zemax. The PCA model was built with approximately 1300 base kernels representing spatially variant point spread functions (PSFs). This model generates kernel samples during the estimation process. Synthetic images were created by convolving the synthetic kernels with reference traffic sign images and compared with real-life data captured by an automotive camera. These synthetic data were utilized for algorithm development, and later on, validation was performed on real-life data. The algorithm extracts two \(45\times 45\) pixels regions of interest (ROIs) containing slanted edges from the blurred image and crops matching ROIs from a reference sharp image. Each candidate kernel was used to blur the reference ROIs, and the resulting SFR was compared with the blurred ROIs’ SFR. Differential evolution optimization minimizes the SFR difference, selecting the kernel that best matches the observed blur. The final kernel was evaluated against the true kernel for accuracy. The structural similarity index measure (SSIM) between the original and estimated blurred ROIs ranges from 0.808 to 0.945. For true vs. estimated kernels, SSIM varies from 0.92 to 0.98. Pearson correlation coefficients range from 0.84 to 0.99, Cosine similarity from 0.86 to 0.99, and mean squared error (MSE) from \(1.1 \times {10}^{-5}\) to \(8.3 \times {10}^{-5}\) . Validation on real-life camera images showed that the SSIM between the estimated and blurred ROI was >0.82, showing promising accuracy in kernel estimation, which could be used towards in-field monitoring of camera sharpness degradation.