<p>Millimeter-wave radar has shown significant potential in privacy-preserving human activity recognition. However, the lack of diverse radar datasets across various scenarios poses a challenge to the robustness and generalization of deep learning models. To address this limitation, existing works mainly focus on synthesizing micro-doppler data from video, range-doppler data, which provides an extra dimension, has been overlooked due to challenges caused by signal offsets. In this paper, we propose a comprehensive approach for synthesizing range-doppler data from videos by leveraging computer vision techniques and principles of camera imaging. Furthermore, we implement a map enhancement and classification model to facilitate human activity recognition. Our approach is validated on a custom dataset, where the proposed range-doppler synthesis method and classification model achieve an accuracy of 97.3% for activity recognition tasks. This performance is comparable to that of vision-based HAR methods, demonstrating the effectiveness of our proposed scheme in achieving privacy-preserving human activity recognition.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Synthesizing mmWave range-doppler data from videos for privacy-preserving human activity recognition

  • Xuehan Zhang,
  • Shuai Wang,
  • Zhiyuan Cui,
  • Borui Li,
  • Xiaolei Zhou,
  • Zhao-Dong Xu,
  • Zhiqiang Li,
  • Shuai Wang

摘要

Millimeter-wave radar has shown significant potential in privacy-preserving human activity recognition. However, the lack of diverse radar datasets across various scenarios poses a challenge to the robustness and generalization of deep learning models. To address this limitation, existing works mainly focus on synthesizing micro-doppler data from video, range-doppler data, which provides an extra dimension, has been overlooked due to challenges caused by signal offsets. In this paper, we propose a comprehensive approach for synthesizing range-doppler data from videos by leveraging computer vision techniques and principles of camera imaging. Furthermore, we implement a map enhancement and classification model to facilitate human activity recognition. Our approach is validated on a custom dataset, where the proposed range-doppler synthesis method and classification model achieve an accuracy of 97.3% for activity recognition tasks. This performance is comparable to that of vision-based HAR methods, demonstrating the effectiveness of our proposed scheme in achieving privacy-preserving human activity recognition.