Caught looking: pitfalls of data visualization in quick decision-making
摘要
We examine the effectiveness of data visualizations to improve quick, intuitive decision-making. In a collegiate baseball context, individuals in our treatment group received graphical data visualizations of decisions made (swings at pitches) and resultant performance (contact with the ball). The control group received summary data in traditional table format. Experimental results provide mixed evidence on the usefulness of data visualizations to improve quick decisions. Participants who received visualizations did not change their decisions. However, their performance decreased across several measures. Although prior literature on learning suggests that this performance decrease would be transient, it persisted throughout the length of the experiment. Our results are an important step in understanding boundary conditions where data visualization tools are helpful (or detrimental) to performance in quick decision-making settings and call for further research. Business practitioners and managers who implement data visualizations into business operations should monitor for negative impacts and be aware that additional support, such as training and education, may be necessary.