Scene understanding is a complex but essential task for humans and machines. Humans have a unique ability to analyze objects in their environment and relate these objects to their background. However, understanding objects and establishing a relationship with background is challenging for machines. They require large amounts of data and complex calculations. This study examines how humans and machines understand visual scenes. The features that humans and machines find saliency during scene understanding are emphasized.