Evaluation is a key part of Design Science Research (DSR). Evaluations can take place in artificial or naturalistic environments, which may be chosen, depending on the type of artifact being developed, and each with their own advantages and disadvantages. With the advent of Industry 5.0, naturalistic evaluations will be more in demand, however these can be difficult, time-consuming and expensive. This study outlines the use of the Critical Incident Technique (CIT) as a useful way to obtain many of the benefits of naturalistic evaluation, such as verisimilitude, and other benefits such as the ability to evaluate in a broader range of settings and improved engagement of participants in the evaluation process. An illustration of the use of this technique is provided, demonstrating how CIT can be a valuable addition to the DSR researcher’s toolbox.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Critical Incident Technique for Semi-Naturalistic DSR Evaluation: A Methodology and an Illustration

  • Charon Abbott,
  • Mary Tate,
  • Wasana Bandara,
  • Lisa Tam

摘要

Evaluation is a key part of Design Science Research (DSR). Evaluations can take place in artificial or naturalistic environments, which may be chosen, depending on the type of artifact being developed, and each with their own advantages and disadvantages. With the advent of Industry 5.0, naturalistic evaluations will be more in demand, however these can be difficult, time-consuming and expensive. This study outlines the use of the Critical Incident Technique (CIT) as a useful way to obtain many of the benefits of naturalistic evaluation, such as verisimilitude, and other benefits such as the ability to evaluate in a broader range of settings and improved engagement of participants in the evaluation process. An illustration of the use of this technique is provided, demonstrating how CIT can be a valuable addition to the DSR researcher’s toolbox.