Color is a useful cue to object properties such as object identity and state (e.g., edibility), and color information supports important communicative functions. Although the perceived color of objects is related to their physical surface properties, this relationship is not straightforward. The ambiguity in perceived color arises because the light entering the eyes contains information about both surface reflectance and prevailing illumination. The challenge of color constancy is to estimate surface reflectance from this mixed signal. In addition to illumination, the spatial context of an object may also affect its color appearance. In this chapter, we discuss how viewing context affects color percepts. We highlight some important results from previous research and move on to discuss what could help us make further progress in the field. Some promising avenues for future research include using individual differences to help in theory development and integrating more naturalistic scenes and tasks along with model comparison into color constancy and color appearance research.