<p>Implicit biases are stereotypes and attitudes that influence decisions and actions, contributing to discrimination and societal inequities. The implicit association test is the most widely used tool for measuring implicit bias, assessing response time in sorting stimuli into labelled categories. Most interpretations assume that implicit association test performance (<i>D</i>-scores) reflects conflicting associative memories or decision ease. We challenged this assumption by decomposing <i>D</i>-scores into additional cognitive processes that may influence results, particularly response caution—the tendency to trade speed for accuracy. Using racing diffusion models across 39 topics (<i>N</i> = 115,601), we found that response caution explained significantly more variance in <i>D</i>-scores beyond decision ease. Response caution also best predicted explicitly reported biases. These findings challenge the traditional interpretation of <i>D</i>-scores as primarily reflecting associative memory activation and highlight the need to consider multiple cognitive processes when assessing implicit biases.</p>