In order to comprehensively understand the current status of heavy metal pollution in Bayan County and the potential harm it may cause to the ecosystem, this study collected surface and deep soil samples from 22 locations and conducted area analysis. The contents of five heavy metals were determined, and the samples were evaluated using single factor index, Nemerow index, and potential ecological risk index. The results showed that the contents of As, Cd, Cr, Hg, and Pb in the surface soil of Bayan County were 9.86 mg/kg, 0.11 mg/kg, 61.35 mg/kg, 0.060 mg/kg, and 23.76 mg/kg, respectively, which were all below the screening values specified in the “Soil Environmental Quality Standards for Agricultural Land Pollution Risk Control” (GB 15618-2018). Among them, As, Cd, Cr, and Pb mainly came from parent materials, while the coefficient of variation of Hg was 1.6, indicating that it was more affected by human activities, and there was significant spatial distribution difference among different regions. According to the Nemerow comprehensive pollution grade evaluation, Hg was classified as heavy pollution, while Cd and Cr were at the light pollution level. The potential ecological hazard degree of various heavy metals in order from high to low was: Hg > Cd > As > Pb > Cr, and they were all within the low potential ecological hazard grade range. The comprehensive ecological risk index (RI) ranged from 44.75 to 345.41, with an average of 87.04, within the low ecological risk region.