Material perception can dramatically change as people age. It can also be altered with brain damage. Studying these changes give us important insights into the perceptual mechanism of materials. Material perception in a broad sense, or Shitsukan perception, includes surface quality and object appearance as well as the texture, which are related to preference or emotional reaction toward an object. Thus, Shitsukan integrates multiple sensory modalities and is essential for object recognition and emotional processing. This chapter examines the influence of neurological disorders and aging on human Shitsukan perception. Two investigative approaches are highlighted: (1) evaluating performance in tasks related to material perception and recognition (“surface Shitsukan”) and (2) analyzing neurophysiological responses to visual appearance changes (“deep Shitsukan”). Findings reveal that aging and brain damage impair Shitsukan perception across visual, tactile, and auditory modalities. In individuals with brain lesions, the extent and modality of perceptual impairment of Shitsukan are determined by lesion localization. Moreover, studies on pupil responses to glare illusions indicate that aging and brain damage diminishes physiological responses, reflecting a decline in Shitsukan perception. These results underscore that surface and deep Shitsukan perception are differently affected by aging and neurological disorders. Addressing these changes through environmental adaptations could significantly enhance the quality of life for older adults and individuals with brain dysfunctions.