<p>Resting heart rate (RHR) is a key biomarker of cardiovascular health and mortality<sup><CitationRef AdditionalCitationIDS="CR2" CitationID="CR1">1</CitationRef>–<CitationRef CitationID="CR3">3</CitationRef></sup>, but passively&#xa0;tracking it longitudinally generally requires a wearable device, limiting its availability. Here we present passive heart-rate monitoring (PHRM), a deep-learning system that uses facial video-based photoplethysmography for passive measurements of heart rate (HR) and RHR during everyday smartphone interactions. Our system was developed using 192,353 videos from 485 participants and validated on 162,546 videos from 211 participants in laboratory and free-living conditions, representing, to our knowledge, the largest validation study of its kind. PHRM outperformed state-of-the-art methods on our benchmarks. Compared with reference electrocardiograms, PHRM achieved a mean absolute percentage error (MAPE) lower than 10% for HR measurements across three skin-tone groups of light, medium and dark pigmentation, meeting industry accuracy standards; MAPE for each skin-tone group was non-inferior versus the others. Daily RHR measured by PHRM had a mean absolute error of less than five beats per minute, compared with a wearable HR tracker, and was associated with known risk factors for cardiovascular disease. These results highlight the potential of smartphones for enabling passive and equitable monitoring of heart health. To&#xa0;facilitate further research, we publicly release a large, annotated smartphone video dataset along with a pre-trained HR model.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Passive heart-rate monitoring during smartphone use in everyday life

  • Shun Liao,
  • Paolo Di Achille,
  • Jiang Wu,
  • Silviu Borac,
  • Jonathan Wang,
  • Xin Liu,
  • Eric S. Teasley,
  • Lawrence Cai,
  • Yuzhe Yang,
  • Yun Liu,
  • Daniel McDuff,
  • Hao-Wei Su,
  • Brent Winslow,
  • Anupam Pathak,
  • Mark Malhotra,
  • Shwetak Patel,
  • James A. Taylor,
  • Jameson K. Rogers,
  • Ming-Zher Poh

摘要

Resting heart rate (RHR) is a key biomarker of cardiovascular health and mortality13, but passively tracking it longitudinally generally requires a wearable device, limiting its availability. Here we present passive heart-rate monitoring (PHRM), a deep-learning system that uses facial video-based photoplethysmography for passive measurements of heart rate (HR) and RHR during everyday smartphone interactions. Our system was developed using 192,353 videos from 485 participants and validated on 162,546 videos from 211 participants in laboratory and free-living conditions, representing, to our knowledge, the largest validation study of its kind. PHRM outperformed state-of-the-art methods on our benchmarks. Compared with reference electrocardiograms, PHRM achieved a mean absolute percentage error (MAPE) lower than 10% for HR measurements across three skin-tone groups of light, medium and dark pigmentation, meeting industry accuracy standards; MAPE for each skin-tone group was non-inferior versus the others. Daily RHR measured by PHRM had a mean absolute error of less than five beats per minute, compared with a wearable HR tracker, and was associated with known risk factors for cardiovascular disease. These results highlight the potential of smartphones for enabling passive and equitable monitoring of heart health. To facilitate further research, we publicly release a large, annotated smartphone video dataset along with a pre-trained HR model.