This paper is to develop one spectral element algorithm for second kind Volterra integral equations with highly oscillatory kernels. We first divide the interval \(I:=[0,1]\) into d intervals \(\{I_k\}_{k=1}^d\) and then present the oscillation-preserving Legendre-Galerkin method on each interval \(I_k\) . Then, we establish that the fully discrete approximate equation has a unique solution, which arrives at the optimal convergence order \(\mathcal {O}( h^rn^{-r})\) independent of the wave number \(\omega \) . Here r denotes the regularity of the original solution, h is the maximal value of the step length \(|I_k|\) and n denote the dimension of the approximate space on \(I_k\) . At last, two numerical examples are presented to validate the effectiveness of our proposed method.