The rate distortion function is the minimum rate that we can represent the (source) sequence with average distortion D. The collection of topics in this chapter contains many classical results which have found utility or mention in agent learning investigations. However, the coding theorem oriented proofs are not provided, since these are in standard information theory texts and also because research in that direction is not appropriate for agent learning performance analyses.