Score-Based Sentence Completion for Interactive Systems Evaluation
摘要
Score-based Sentence Completion was developed creatively to support a change in direction when evaluating an innovative identity management system. Project discussions of evaluation approaches broadened considerations to include a worth-focus (Wo-Fo). Standard evaluation questionnaires could not accommodate this broadened focus, nor could they be repurposed in a workable manner. Sentence completion was also considered as this had already been used for Wo-Fo evaluation. While this can readily be repurposed for specific projects, the costs of study design and results analysis would only be workable if generic project-independent sentence stems were used. These were well suited for Wo-Fo evaluation. Once complemented by scoring scales, as in standard evaluation questionnaires, rich evaluation data could be collected. A spontaneous research through design process combined initial sensitising concepts (workability, repurposability, generic sentence stems, scored sentence completion) into a simple abstraction of SCore-based Sentence Completion (2SC), which was then creatively instantiated as a playful, visual, tangible, interactive evaluation practice, based on the darts game (Darts-2SC). Darts-2SC proved to be workable in the evaluation context for identity management. A few revisions to Darts-2SC were made before assessing repurposability when evaluating e-shopping prototypes. As a result of assessments in use, prescriptions for the use of Darts-2SC can be offered, completing a research through design process.