Traditional Chinese medicinal herbs are invaluable treasures to the world. Over thousands of years of development, they have continuously advanced, making significant contributions to human health. In recent years, with the increasing health awareness among the public, the demand for traditional Chinese medicinal materials has been growing year by year. Currently, the majority of these materials on the market come from artificial cultivation. However, during the processes of planting, storage, and processing, they are susceptible to contamination by exogenous pollutants, leading to a decline in quality and posing potential threats to human health. This article provides a systematic review of the current status and detection technologies for common exogenous pollutant residues in traditional Chinese medicinal materials. Additionally, using the Chinese herb Astragalus as an example, it examines the residues of pesticides, mycotoxins, and heavy metals in Astragalus, aiming to offer important data support for the sustainable development of the traditional Chinese medicine industry.