This chapter predominantly is of mathematical nature. It considers main contributions of Fenchel and Rockafellar about duality and from von Neumann about game theory. The chapter also includes a third part, which introduces proximal methods. These proximal methods open the way for non-smooth analysis and optimization, so our application domain can also consider scenarios with non-differentiable functions (this is the case of some machine learning and some signal and image processing techniques).