Scholarlink

The increasing ubiquity of the Internet of Things (IoT) and smart devices equipped with embedded human body sensors has intensified the focus on Human Activity Recognition (HAR). However, HAR, which relies on sensor data, faces challenges related to feature extraction and data correlation. To address these issues, our paper proposes a Multi-Sensor Fusion Network (MSFNet). This model leverages accelerometer and gyroscope time-domain data, transforms it into the frequency domain, and extracts features from both domains to enhance feature interaction through Self-Supervised Learning (SSL). MSFNet fuses time-frequency data and employs four encoders for feature extraction, along with two SSL tasks to improve classifier accuracy. Our experimental results demonstrate the model’s effectiveness and its competitive performance compared to existing benchmarks. The code can be accessed via the Github link https://github.com/bx12138/MSFNet

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Multi-sensor Fusion Framework for HAR: Integrating Time-Frequency Features and Self-supervised Learning

  • 会议论文

  • 发表日期：

    2026年

查看全文
  • Xiang Wu,
  • Wei Zhang

摘要

The increasing ubiquity of the Internet of Things (IoT) and smart devices equipped with embedded human body sensors has intensified the focus on Human Activity Recognition (HAR). However, HAR, which relies on sensor data, faces challenges related to feature extraction and data correlation. To address these issues, our paper proposes a Multi-Sensor Fusion Network (MSFNet). This model leverages accelerometer and gyroscope time-domain data, transforms it into the frequency domain, and extracts features from both domains to enhance feature interaction through Self-Supervised Learning (SSL). MSFNet fuses time-frequency data and employs four encoders for feature extraction, along with two SSL tasks to improve classifier accuracy. Our experimental results demonstrate the model’s effectiveness and its competitive performance compared to existing benchmarks. The code can be accessed via the Github link https://github.com/bx12138/MSFNet