There is an increasing recognition of unique challenges faced in the case of neurodivergence among the scientific workforce by organizations and policymakers. A full appraisal of such challenges should be informed by the history of how autistic individuals have been treated and accommodated in the scientific workforce. Moreover, an argument is put forward in this perspective that the progress of science has actually been immensely benefited by accommodating neurodivergence, and the exclusion is rather a more recent phenomenon. We argue that once we get a deeper understanding of the structural aspects of scientific progress and how diverse human sensory experiences influence it, only then a more successful effort can be made towards furthering inclusivity in scientific workplaces. Finally, we discuss briefly how we need to pay heed to the specific needs within a scientific environment, common obstacles in scientific careers, accommodative policies that can be practically implemented, discernible mitigating efforts to challenge stereotypes surrounding neurodivergent individuals and the crucial importance of developing effective mentorship and supportive communities.