With the expansion of the fruit industry, the Yangling Demonstration Zone in Shaanxi province, recognized as a national agricultural high-tech industrial demonstration area, has seen its orchard cultivation area steadily increase. The frequency of using fertilizers, irrigation, and other agricultural resources has risen significantly. While this has led to higher fruit yields, it has also raised concerns about the potential for heavy metal pollution in the soil. The long-term accumulated heavy metals such as Cr, Cd, Cu and Pb may be transferred through the soil–plant-food chain, threatening the security of the ecosystem and the quality of agricultural products, and affecting the sustainable development of regional agriculture. To assess the current situation and ecological risks of heavy metal pollution in the soil of orchards in this area, this study focuses on the soil environment of three typical orchards of kiwifruit, grapes and figs in the region. By gathering nine soil samples, the contamination levels and ecological risks of four heavy metals (Cr, Cd, Cu, and Pb) were assessed using the geological accumulation index, single pollution index, Nemerow comprehensive pollution index, and potential ecological risk index. The findings indicate that Cd pollution is the most serious, with three samples exhibiting Cd concentrations two to three times higher than the national risk screening threshold. The overall ecological risk is classified from moderate to high. The heavy metal contamination observed in the orchard soils of the Yangling Demonstration Zone seems to be linked to fertilization methods, water sources, and the physicochemical characteristics of the soil. To mitigate Cd buildup, it is essential to conduct regular monitoring of soil heavy metal concentrations, improve fertilization practices by limiting the use of phosphorus fertilizers with high Cd content, and manage water and fertilizer applications according to scientific recommendations.