Gradient descentGradient descent-based local searchLocal search can dramatically improve solution performance in symbolic regression tasks, at the cost of significantly higher runtime as well as increased risks of overfitting. In this paper, we investigate exactly what amount of local searchLocal search is really needed within the GP population. We show that low intensity local searchLocal search is sufficient to boost the fitness of the entire population, provided that local searchLocal search information in the form of optimized numerical parameters is written back into the genotype at least some of the time. Our results suggest that spontaneous adaptations (in the Lamarckian sense) act as evolutionary fuel for the Baldwin effectBaldwin effect in genetic programming, and that in the absence of the former, the latter does not occur and evolution is hindered. The Lamarckian model works particularly well in symbolic regression, as local searchLocal search only affects model coefficients and does not affect the inheritance of useful building blocks contained in theGradient descent model structure. Symbolic regression