Pipe cooling is an important measure for controlling the temperature in mass concrete structures, so it is one of the key problems to specifically simulate the effect of the cooling pipes in temperature field analysis. Because the size of cooling pipe is quite small from that of mass concrete structure, its exact simulation is the focus of simulation calculation. In this paper, a new method called SEM (superposed element method) is proposed to analyze the temperature field of mass concrete with cooling pipes in it. First, the structure is divided into two independent meshes. One is the global mesh without cooling pipes, and the other is the local mesh of the cooling pipes together with its adjacent region. Then the elements within the local mesh is treated based on FEM, and the two independent meshes are coupled together through the coupling surface by the coordination of heat conduction. Finally, using the SEM proposed in this paper, the numerical model with a single pipe was analyzed and the calculation precision was validated. The convenient process of grid discretization and good performance in both precision and efficiency show the feasibility of the new method in engineering application.