<p>Carbon black filled rubber is a versatile material, which can be used as anti-vibration component in engineering. However, the time dependent behavior, such as stress relaxation, is undesirable in the process of long-term service, which has great influence on the mechanical performances. In addition, its long-term stress relaxation test is time- and cost-intensive. To this end, this paper proposed an approach to predict the stress relaxation from the short-term dynamic mechanical tests. On the basis of time–temperature superposition principle, master curve of storage modulus was obtained, and the accuracy of shift factors was verified by means of the Williams-Landel-Ferry equation. The Prony series models were used to simulate the master curve of storage modulus, and the parameters were determined by use of collocation method. Compared with the previous works, the collocation method had the advantages of avoiding the occurrence of negative fitting parameters and fitting curve’s waviness. After substituting the fitting parameters into the Prony series models, the relaxation modulus curve was generated. To ensure accuracy of the converted relaxation modulus, the short-term stress relaxation tests were carried out. Compared the converted relaxation modulus with the experimental one, RMSE equals 0.393, which verifies the reliability of the proposed method.</p>