<p>Eye gaze reveals one’s attentional focus in social interaction. However, most existing gaze estimation systems can only sense gaze activities within a specific angular range for a particular individual, thus limiting their applicability in multi-person face-to-face scenarios. In this paper, we propose GAM360, a flexible system that enables 360-degree multi-person 3D gaze and screen point-of-gaze (PoG) estimation. Different from previous techniques, we build the system based on a bottom-up fisheye camera, which can sense gaze activities from users in different directions simultaneously. We develop a real-time multi-person 3D gaze estimation algorithm, along with a method for multi-person screen PoG estimation. Experimental results demonstrate that the system can accurately track the gaze of multiple users in 360 degrees, achieving a 3D gaze estimation angular error of <InlineEquation ID="IEq1"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="42486_2024_168_Article_IEq1.gif" Format="GIF" Height="15" Rendition="HTML" Resolution="72" Type="Linedraw" Width="70" /> </InlineMediaObject> <EquationSource Format="TEX">\(8.7^\circ {\pm } 4.9^\circ\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mn>8</mn> <mo>.</mo> <msup> <mn>7</mn> <mo>∘</mo> </msup> <mo>±</mo> <mn>4</mn> <mo>.</mo> <msup> <mn>9</mn> <mo>∘</mo> </msup> </mrow> </math></EquationSource> </InlineEquation> under free head movement. Furthermore, we validate the effectiveness of the system across various application scenarios, including group discussion, desktop environment, and classroom environment, providing new insights into ubiquitous gaze sensing.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Gam360: sensing gaze activities of multi-persons in 360 degrees

  • Zhuojiang Cai,
  • Haofei Wang,
  • Yuhao Niu,
  • Feng Lu

摘要

Eye gaze reveals one’s attentional focus in social interaction. However, most existing gaze estimation systems can only sense gaze activities within a specific angular range for a particular individual, thus limiting their applicability in multi-person face-to-face scenarios. In this paper, we propose GAM360, a flexible system that enables 360-degree multi-person 3D gaze and screen point-of-gaze (PoG) estimation. Different from previous techniques, we build the system based on a bottom-up fisheye camera, which can sense gaze activities from users in different directions simultaneously. We develop a real-time multi-person 3D gaze estimation algorithm, along with a method for multi-person screen PoG estimation. Experimental results demonstrate that the system can accurately track the gaze of multiple users in 360 degrees, achieving a 3D gaze estimation angular error of \(8.7^\circ {\pm } 4.9^\circ\) 8 . 7 ± 4 . 9 under free head movement. Furthermore, we validate the effectiveness of the system across various application scenarios, including group discussion, desktop environment, and classroom environment, providing new insights into ubiquitous gaze sensing.