Integrating artificial intelligence (AI) into decision-support systems (DSS) for aviation offers real-time decision support but complicates trust calibration between human operators and AI. This study examined how feedback style from such a DSS, the Cognitive Shadow, influences trust during a simulated weather-avoidance task. Forty-four participants completed 150 knowledge-elicitation trials, followed by 20 test trials where the DSS generated predictions. When participant decisions diverged from the DSS suggestion, it issued explicit recommendations; matching human-DSS decisions prompted no feedback, representing implicit agreement. Trust was measured using the 12-item Checklist for Trust between People and Automation. Rejection of explicit recommendations, as a proportion of all such explicit cues, was negatively correlated with trust (r(41) = −0.62, p < 0.001), while acceptance was positively correlated (r(41) = 0.47, p = 0.001). The proportion of silent agreements showed no association with trust (r(41) = −0.02, p = 0.895). These results suggest that explicit feedback—both confirming and corrective—acts as a key cue for calibrating trust, while implicit agreement carries little weight. Trust appears more sensitive to how the system communicates than to whether its decisions align with those of the user. This aligns with recent findings that transparency, not just accuracy, drives trust in AI. Designing DSS that strategically balance explicit feedback with minimal intrusiveness may enhance operator trust and performance. Future research will manipulate feedback valence and visibility in a between-group design to further disentangle how communication style shapes trust in high-stakes human–AI collaboration.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

When AI Stays Silent: Hidden Agreement May Undermine Trust Building in Adaptive Decision Support and Training

  • Jonay Ramon Alaman,
  • Daniel Lafond,
  • Alexandre Marois,
  • Sébastien Tremblay

摘要

Integrating artificial intelligence (AI) into decision-support systems (DSS) for aviation offers real-time decision support but complicates trust calibration between human operators and AI. This study examined how feedback style from such a DSS, the Cognitive Shadow, influences trust during a simulated weather-avoidance task. Forty-four participants completed 150 knowledge-elicitation trials, followed by 20 test trials where the DSS generated predictions. When participant decisions diverged from the DSS suggestion, it issued explicit recommendations; matching human-DSS decisions prompted no feedback, representing implicit agreement. Trust was measured using the 12-item Checklist for Trust between People and Automation. Rejection of explicit recommendations, as a proportion of all such explicit cues, was negatively correlated with trust (r(41) = −0.62, p < 0.001), while acceptance was positively correlated (r(41) = 0.47, p = 0.001). The proportion of silent agreements showed no association with trust (r(41) = −0.02, p = 0.895). These results suggest that explicit feedback—both confirming and corrective—acts as a key cue for calibrating trust, while implicit agreement carries little weight. Trust appears more sensitive to how the system communicates than to whether its decisions align with those of the user. This aligns with recent findings that transparency, not just accuracy, drives trust in AI. Designing DSS that strategically balance explicit feedback with minimal intrusiveness may enhance operator trust and performance. Future research will manipulate feedback valence and visibility in a between-group design to further disentangle how communication style shapes trust in high-stakes human–AI collaboration.