This chapter investigates the feasibility and challenges of using millimetre-wave radar for gesture recognition on deformable objects, such as plush toys or other objects made of flexible materials, which are typically not instrumented with sensors. Unlike vision-based systems, which are limited by occlusion and require clear line of sight, radar sensing can detect gestures through non-conductive materials. The authors compare prior work on gesture recognition performance across mid-air, on-object and on-deformable-object contexts using different radar signal representations and deep learning models. In addition, the authors conduct an experiment demonstrating that object deformations do not negatively impact recognition accuracy. These findings open new possibilities for contactless interaction with soft materials in everyday environments without requiring embedded instrumentation.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Radar-Based Gesture Recognition on Deformable Objects

  • Klen Čopič Pucihar,
  • Matjaž Kljun,
  • Nuwan T. Attygalle

摘要

This chapter investigates the feasibility and challenges of using millimetre-wave radar for gesture recognition on deformable objects, such as plush toys or other objects made of flexible materials, which are typically not instrumented with sensors. Unlike vision-based systems, which are limited by occlusion and require clear line of sight, radar sensing can detect gestures through non-conductive materials. The authors compare prior work on gesture recognition performance across mid-air, on-object and on-deformable-object contexts using different radar signal representations and deep learning models. In addition, the authors conduct an experiment demonstrating that object deformations do not negatively impact recognition accuracy. These findings open new possibilities for contactless interaction with soft materials in everyday environments without requiring embedded instrumentation.