<p>Single-pixel imaging (SPI) uses pixel arrays with coded illumination and a single detector to reconstruct an image of a scene. However, it is time-consuming due to the many projected patterns and non-trivial reconstruction. We pursue a practical route to real-time SPI by pairing fast linear reconstructions with a compact U-Net denoiser on an embedded GPU. In a fully <i>simulated</i> pipeline, we form undersampled reconstructions from CelebA-derived <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(64\times 64\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mn>64</mn> <mo>×</mo> <mn>64</mn> </mrow> </math></EquationSource> </InlineEquation> grayscale faces using Hadamard patterns ordered by <i>Cake Cutting</i> at <InlineEquation ID="IEq2"> <EquationSource Format="TEX">\(M/N\in \{4,8,16,24,32\%\}\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>M</mi> <mo stretchy="false">/</mo> <mi>N</mi> <mo>∈</mo> <mo stretchy="false">{</mo> <mn>4</mn> <mo>,</mo> <mn>8</mn> <mo>,</mo> <mn>16</mn> <mo>,</mo> <mn>24</mn> <mo>,</mo> <mn>32</mn> <mo>%</mo> <mo stretchy="false">}</mo> </mrow> </math></EquationSource> </InlineEquation>. The denoiser is trained with mean squared error (MSE) on normalized images and deployed on a Jetson Orin NX 16&#xa0;GB (FP32). We measure the acquisition time, reconstruction time, and inference time of the U-Net model per frame. Quality is reported with PSNR and SSIM, and performance with serial latency and pipelined throughput. Results indicate that GPU inference markedly cuts denoising time, shifting the bottleneck toward optical acquisition and/or the linear step as sampling grows. The study offers a reproducible recipe–data generation, models, and timing methodology–for assessing SPI denoising on edge hardware, and outlines levers to raise throughput: higher-rate pattern projection, optimized reconstruction kernels, and right-sized U-Net variants that preserve PSNR/SSIM while lowering latency.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Accelerated deep learning denoising for edge AI in single-pixel imaging

  • Carlos Chabert-Ull,
  • Heberley Tobón-Maya,
  • Samuel I. Zapata-Valencia,
  • Enrique Tajahuerce,
  • Germán León

摘要

Single-pixel imaging (SPI) uses pixel arrays with coded illumination and a single detector to reconstruct an image of a scene. However, it is time-consuming due to the many projected patterns and non-trivial reconstruction. We pursue a practical route to real-time SPI by pairing fast linear reconstructions with a compact U-Net denoiser on an embedded GPU. In a fully simulated pipeline, we form undersampled reconstructions from CelebA-derived \(64\times 64\) 64 × 64 grayscale faces using Hadamard patterns ordered by Cake Cutting at \(M/N\in \{4,8,16,24,32\%\}\) M / N { 4 , 8 , 16 , 24 , 32 % } . The denoiser is trained with mean squared error (MSE) on normalized images and deployed on a Jetson Orin NX 16 GB (FP32). We measure the acquisition time, reconstruction time, and inference time of the U-Net model per frame. Quality is reported with PSNR and SSIM, and performance with serial latency and pipelined throughput. Results indicate that GPU inference markedly cuts denoising time, shifting the bottleneck toward optical acquisition and/or the linear step as sampling grows. The study offers a reproducible recipe–data generation, models, and timing methodology–for assessing SPI denoising on edge hardware, and outlines levers to raise throughput: higher-rate pattern projection, optimized reconstruction kernels, and right-sized U-Net variants that preserve PSNR/SSIM while lowering latency.