Determining a solution \(\boldsymbol {x}\) of an equation \(F(\boldsymbol {x}) = \boldsymbol {a}\) is one of the most important and frequent problems in applied mathematics. In fact, it is often not possible to explicitly and exactly specify the solution of such an equation. Numerical mathematics provides iterative methods for the approximate solution of (linear and non-linear) equations and systems of equations.