Scholarlink

<p>Neuromorphic diffusion models have become one of the major breakthroughs in the field of generative artificial intelligence. Unlike discriminative models that have been well developed to tackle classification or regression tasks, diffusion models aim at creating content based upon contexts learned. However, the more complex algorithms of these models result in high computational costs using today’s technologies. Here, we develop a spintronic voltage-controlled magnetoelectric memory hardware for the neuromorphic diffusion process. The in-memory computing capability of our spintronic devices goes beyond current Von Neumann architecture, where memory and computing units are separated. Together with the non-volatility of magnetic memory, we can achieve high-speed and low-cost computing, which is desirable for the increasing scale of generative models in the current era. We experimentally demonstrate that the hardware-based true random diffusion process can be implemented for image generation and achieve comparable image quality to software-based training as measured by the Fréchet inception distance (FID) score, achieving ~10<sup>3</sup> better energy-per-bit-per-area over traditional hardware.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Voltage-controlled magnetoelectric devices for neuromorphic diffusion process

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2025年5月30日

查看全文
  • Yang Cheng,
  • Qingyuan Shu,
  • Albert Lee,
  • Haoran He,
  • Ivy Zhu,
  • Minzhang Chen,
  • Renhe Chen,
  • Zirui Wang,
  • Hantao Zhang,
  • Chih-Yao Wang,
  • Shan-Yi Yang,
  • Yu-Chen Hsin,
  • Cheng-Yi Shih,
  • Hsin-Han Lee,
  • Ran Cheng,
  • Kang L. Wang

摘要

Neuromorphic diffusion models have become one of the major breakthroughs in the field of generative artificial intelligence. Unlike discriminative models that have been well developed to tackle classification or regression tasks, diffusion models aim at creating content based upon contexts learned. However, the more complex algorithms of these models result in high computational costs using today’s technologies. Here, we develop a spintronic voltage-controlled magnetoelectric memory hardware for the neuromorphic diffusion process. The in-memory computing capability of our spintronic devices goes beyond current Von Neumann architecture, where memory and computing units are separated. Together with the non-volatility of magnetic memory, we can achieve high-speed and low-cost computing, which is desirable for the increasing scale of generative models in the current era. We experimentally demonstrate that the hardware-based true random diffusion process can be implemented for image generation and achieve comparable image quality to software-based training as measured by the Fréchet inception distance (FID) score, achieving ~103 better energy-per-bit-per-area over traditional hardware.