We consider a non-autonomous stochastic wave equation driven by superlinear colored noise defined on the entire space \({\mathbb {R}}^m\) , where the nonlinear drift and diffusion terms growing like polynomial functions with critical and superlinear growing rates \(p\) and \(q\) , respectively: \(\begin{aligned} 1 \leqslant q< p< \infty \quad \text {for } m = 1, 2, \quad \text {and otherwise, } 1 \leqslant q < p \leqslant \frac{m}{m-2}. \end{aligned}\) The number \(\frac{m}{m-2}\) is known as the critical exponent for the standard wave equation. Under certain conditions on the time-dependent drift and diffusion terms, we establish the asymptotically autonomous upper semicontinuity of the pullback random attractor \({\mathcal {K}}(\tau ,\omega )\) as the time parameter \(\tau \) tends to both positive and negative infinity, respectively. In this work, we derive an asymptotically autonomous uniform convergence result on the solutions of the non-autonomous stochastic wave equations. This allows us to directly establish the asymptotically autonomous upper semicontinuity of the random attractors for which we do not need to prove that the usual pullback asymptotic compactness of the solution operators is uniform over the infinite time intervals \( [\tau , +\infty ) \) and \( (-\infty , \tau ] \) .