Scholarlink

<p>In recent years, there has been an increasing interest in human-machine teaming for search and rescue operations, deep space missions, and agricultural tasks, among others. To be effective teammates, artificial agents should be able to detect and be responsive to systemic human cognitive states such as workload, sense of urgency, mind wandering, interference, and distraction. Here, we introduce an experimental paradigm and a comprehensive multimodal dataset that provides the necessary data for analyzing the relationships among multiple systematic human cognitive states, enables the development of robust prediction models of these states, and details the framework for developing new experiments. The introduced experimental setup allows for the synchronized real-time recording of multiple data streams from various sensing devices including fNIRS, EEG, pupillometry, respiration, electrodermal activity, and plethysmography, and is applicable in many other interactive task settings where human performance needs to be monitored. The dataset was acquired from 80 subjects performing a driving task and several secondary tasks including car braking events, dialogue communications, and tactile stimulations.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

A Multimodal Virtual Reality Data Acquisition Platform and Dataset to Assess Systemic Human Cognitive States

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2025年12月9日

查看全文
  • Ayca Aygun,
  • Giles Blaney,
  • Zachary Haga,
  • Thomas McWilliams,
  • Julia Mertens,
  • J. P. de Ruiter,
  • Nathan Ward,
  • Matthias Scheutz

摘要

In recent years, there has been an increasing interest in human-machine teaming for search and rescue operations, deep space missions, and agricultural tasks, among others. To be effective teammates, artificial agents should be able to detect and be responsive to systemic human cognitive states such as workload, sense of urgency, mind wandering, interference, and distraction. Here, we introduce an experimental paradigm and a comprehensive multimodal dataset that provides the necessary data for analyzing the relationships among multiple systematic human cognitive states, enables the development of robust prediction models of these states, and details the framework for developing new experiments. The introduced experimental setup allows for the synchronized real-time recording of multiple data streams from various sensing devices including fNIRS, EEG, pupillometry, respiration, electrodermal activity, and plethysmography, and is applicable in many other interactive task settings where human performance needs to be monitored. The dataset was acquired from 80 subjects performing a driving task and several secondary tasks including car braking events, dialogue communications, and tactile stimulations.