This paper presents findings from an expert evaluation of GAHAC, a technology designed to assess the hedonic aspects of user experience (UX) in text-based chatbot interactions. Although existing evaluation methods often focus on usability, GAHAC addresses the often overlooked emotional and psychological dimensions. The study involved 15 academic and industry experts in Human-Computer Interaction (HCI) and chatbot design, who provided in-depth qualitative feedback on GAHAC through semi-structured interviews. Using Grounded Theory as the analytical method, the researchers identified six thematic categories that reflect the participants’ perceptions of the structure, clarity, and theoretical grounding. Key insights included the need for a more consistent organization of hedonic aspects, clearer guidelines, and stronger conceptual support for emotional constructs. The participants also highlighted the importance of including practical examples, minimizing redundancy, and considering thematic groupings to improve comprehension. The findings suggest that GAHAC offers valuable contributions to the evaluation of chatbot UX while providing insights for refinement. Future work will focus on restructuring the technology, enhancing support materials with examples and anti-patterns, and conducting further validation studies to confirm its utility and applicability across different chatbot contexts.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Expert Evaluation of a Technology for Assessing Hedonic Aspects of UX in Text-Based Chatbots

  • Pamella A. de L. Mariano,
  • Ana Paula Chaves,
  • Natasha M. C. Valentim

摘要

This paper presents findings from an expert evaluation of GAHAC, a technology designed to assess the hedonic aspects of user experience (UX) in text-based chatbot interactions. Although existing evaluation methods often focus on usability, GAHAC addresses the often overlooked emotional and psychological dimensions. The study involved 15 academic and industry experts in Human-Computer Interaction (HCI) and chatbot design, who provided in-depth qualitative feedback on GAHAC through semi-structured interviews. Using Grounded Theory as the analytical method, the researchers identified six thematic categories that reflect the participants’ perceptions of the structure, clarity, and theoretical grounding. Key insights included the need for a more consistent organization of hedonic aspects, clearer guidelines, and stronger conceptual support for emotional constructs. The participants also highlighted the importance of including practical examples, minimizing redundancy, and considering thematic groupings to improve comprehension. The findings suggest that GAHAC offers valuable contributions to the evaluation of chatbot UX while providing insights for refinement. Future work will focus on restructuring the technology, enhancing support materials with examples and anti-patterns, and conducting further validation studies to confirm its utility and applicability across different chatbot contexts.