Human Activity Recognition (HAR) enables context-aware applications using sensor data, supporting advancements in IoT-based health monitoring, smart environments, and ambient assisted living. With the growing use of smartphone sensors, time-series data from accelerometers and gyroscopes have become a primary modality for activity classification. This study presents a deep learning-based HAR framework employing both raw time-series and image-transformed representations to assess the comparative performance of 1D and 2D Convolutional Neural Networks (CNNs), alongside Transfer Learning (TL) techniques using well-known pretrained models such as ResNet50 and VGG16. A large-scale dataset of 1.5 million tri-axial accelerometer records was collected from five users performing five daily activities. Raw data were used to train a 1D-CNN, while sliding-window transformations enabled 2D-CNN evaluation, confirming the effectiveness of image-based representations for activity recognition. Building on this, TL was applied by fine-tuning pretrained models at varying input image resolutions. Among the evaluated models, VGG16 at 300 \(\times \) 300 resolution achieved the highest classification accuracy of 98.70%, demonstrating the effectiveness of TL in retaining fine-grained discriminative features. These results highlight the strong generalization capability of pretrained CNNs on image-based sensor data, advocating their suitability for robust, reliable, and scalable activity recognition in real-world IoT-driven applications.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Transfer Learning Framework on Image-Transformed Sensor Data for Smartphone Based Human Activity Recognition

  • Subham Das,
  • Anindita Saha,
  • Chandreyee Chowdhury

摘要

Human Activity Recognition (HAR) enables context-aware applications using sensor data, supporting advancements in IoT-based health monitoring, smart environments, and ambient assisted living. With the growing use of smartphone sensors, time-series data from accelerometers and gyroscopes have become a primary modality for activity classification. This study presents a deep learning-based HAR framework employing both raw time-series and image-transformed representations to assess the comparative performance of 1D and 2D Convolutional Neural Networks (CNNs), alongside Transfer Learning (TL) techniques using well-known pretrained models such as ResNet50 and VGG16. A large-scale dataset of 1.5 million tri-axial accelerometer records was collected from five users performing five daily activities. Raw data were used to train a 1D-CNN, while sliding-window transformations enabled 2D-CNN evaluation, confirming the effectiveness of image-based representations for activity recognition. Building on this, TL was applied by fine-tuning pretrained models at varying input image resolutions. Among the evaluated models, VGG16 at 300 \(\times \) 300 resolution achieved the highest classification accuracy of 98.70%, demonstrating the effectiveness of TL in retaining fine-grained discriminative features. These results highlight the strong generalization capability of pretrained CNNs on image-based sensor data, advocating their suitability for robust, reliable, and scalable activity recognition in real-world IoT-driven applications.