The well-being of mice is critical in pre-clinical research laboratory studies to achieve high-quality experimental results and to mitigate ethical concerns. In this context, the paper proposes a generative intelligent solution for producing human-readable descriptions of mice’s behavior living in a video sensorized cage. By deploying models on off-the-shelf edge devices, this work contributes to the current efforts of the EdgeAI Foundation aimed at bringing Generative AI at the edge. The neural models employed were built using the VideoMAE transformer as an encoder, the Open Pre-Trained Transformer, as the decoder, generating textual descriptions of the predicted behavior. The tiniest version devised, named TinyV2A, achieved a 271 ms inference time and required 1.3 GB of memory on the Raspberry Pi 5. Tiny Text to Speech completed the pipeline, known as Piper, with 15.65 M parameters.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Action Prediction with Edge Generative AI for Mice Pre-clinical Studies

  • Gioele Fiorenza,
  • Danilo Pietro Pau,
  • Raimondo Schettini

摘要

The well-being of mice is critical in pre-clinical research laboratory studies to achieve high-quality experimental results and to mitigate ethical concerns. In this context, the paper proposes a generative intelligent solution for producing human-readable descriptions of mice’s behavior living in a video sensorized cage. By deploying models on off-the-shelf edge devices, this work contributes to the current efforts of the EdgeAI Foundation aimed at bringing Generative AI at the edge. The neural models employed were built using the VideoMAE transformer as an encoder, the Open Pre-Trained Transformer, as the decoder, generating textual descriptions of the predicted behavior. The tiniest version devised, named TinyV2A, achieved a 271 ms inference time and required 1.3 GB of memory on the Raspberry Pi 5. Tiny Text to Speech completed the pipeline, known as Piper, with 15.65 M parameters.