Critical Incident Technique for Semi-Naturalistic DSR Evaluation: A Methodology and an Illustration
摘要
Evaluation is a key part of Design Science Research (DSR). Evaluations can take place in artificial or naturalistic environments, which may be chosen, depending on the type of artifact being developed, and each with their own advantages and disadvantages. With the advent of Industry 5.0, naturalistic evaluations will be more in demand, however these can be difficult, time-consuming and expensive. This study outlines the use of the Critical Incident Technique (CIT) as a useful way to obtain many of the benefits of naturalistic evaluation, such as verisimilitude, and other benefits such as the ability to evaluate in a broader range of settings and improved engagement of participants in the evaluation process. An illustration of the use of this technique is provided, demonstrating how CIT can be a valuable addition to the DSR researcher’s toolbox.