The rapid rise of agentic AI in mental health exposes a misalignment between conversational fluency and user safety. We present a multidimensional framework spanning nine evaluation domains—from clinical validity to relational risk and regulatory compliance—designed to assess agentic systems beyond surface metrics. Applying it to eight real-world tools reveals that the most popular agents often lack basic safeguards, while clinically validated solutions remain underutilized. These findings highlight the need for structured oversight and public awareness. Our framework offers a foundation for safer deployment, informed regulation, and design practices grounded in mental health ethics.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Beyond Engagement: A Multidimensional Framework to Evaluate the Safe Development of Agentic AI in Mental Health

  • Beatriz Garcia Santa Cruz,
  • Carlos Vega,
  • Philip Santangelo,
  • Venkata Satagopam

摘要

The rapid rise of agentic AI in mental health exposes a misalignment between conversational fluency and user safety. We present a multidimensional framework spanning nine evaluation domains—from clinical validity to relational risk and regulatory compliance—designed to assess agentic systems beyond surface metrics. Applying it to eight real-world tools reveals that the most popular agents often lack basic safeguards, while clinically validated solutions remain underutilized. These findings highlight the need for structured oversight and public awareness. Our framework offers a foundation for safer deployment, informed regulation, and design practices grounded in mental health ethics.