<p>Building a neuromorphic vision sensor capable of signal processing and spike generation is essential for developing hardware tailored to brain-inspired spiking neural networks. A critical challenge, however, is the constrained adaptive sensitivity when dealing with expanding ranges of light intensity. Here we show a neuromorphic vision sensor built on a one-transistor-one-memristor pixel structure, attaining high encoding-sensitivity over a broad intensity range by fusing complementary superlinear and sublinear encoding. Specifically, the superlinear intensity-to-spike firing is based on the plasmonic volatile Ag/hBN/Au memristor, which has the high time-to-first-spike (TTFS)- and rate- encoding sensitivity in high-brightness. And the sublinear firing behavior is based on the MoS<sub>2</sub> synaptic photodetector and volatile Ag/hBN/Au memristor neuron, which has the high TTFS- and rate- encoding sensitivity in dim light. When deployed in polar environments (intense brightness to darkness), the complementary vision sensor achieves high-quality imaging, segmenting ice/land regions and predicting thickness—showcasing its robustness under challenging conditions.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

High encoding-sensitivity vision sensor with complementary nonlinear neuromorphic computing

  • Quan Yang,
  • Chuanqing Wang,
  • Ziyang Shen,
  • Yu Kang,
  • Cheng Zhang,
  • Yuanyuan Zhou,
  • Zheng Bian,
  • Xiangwei Su,
  • Chunlian Qin,
  • Jiabao Sun,
  • Yanhua Liu,
  • Bowen Zhu,
  • Zhuangjun Fan,
  • Mohamad Sawan,
  • Yang Xu,
  • Bin Yu,
  • Yang Chai,
  • Yuda Zhao

摘要

Building a neuromorphic vision sensor capable of signal processing and spike generation is essential for developing hardware tailored to brain-inspired spiking neural networks. A critical challenge, however, is the constrained adaptive sensitivity when dealing with expanding ranges of light intensity. Here we show a neuromorphic vision sensor built on a one-transistor-one-memristor pixel structure, attaining high encoding-sensitivity over a broad intensity range by fusing complementary superlinear and sublinear encoding. Specifically, the superlinear intensity-to-spike firing is based on the plasmonic volatile Ag/hBN/Au memristor, which has the high time-to-first-spike (TTFS)- and rate- encoding sensitivity in high-brightness. And the sublinear firing behavior is based on the MoS2 synaptic photodetector and volatile Ag/hBN/Au memristor neuron, which has the high TTFS- and rate- encoding sensitivity in dim light. When deployed in polar environments (intense brightness to darkness), the complementary vision sensor achieves high-quality imaging, segmenting ice/land regions and predicting thickness—showcasing its robustness under challenging conditions.