Visual agnosia has been well studied by anatomical, neuropsychological and neuroimaging studies. However, functional changes in the brain have been rarely assessed by electrophysiological methods. We carried out electrophysiological examinations on a 23-year-old man with associative visual agnosia, prosopagnosia and cerebral achromatopsia to evaluate the higher brain dysfunctions of visual recognition. Electrophysiological methods consisted of achromatic, chromatic and category-specific visual evoked potentials (CS-VEPs), and event-related potentials (ERPs) with color and motion discrimination tasks. Brain magnetic resonance imaging revealed large white matter lesions in the bilateral temporo-occipital lobes involving the lingual and fusiform gyri (V4) and inferior longitudinal fasciculi due to multiple sclerosis. Examinations including CS-VEPs demonstrated dysfunctions of face and object perception while sparing semantic word perception after primary visual cortex (V1) in the ventral pathway. ERPs showed abnormal color perception in the ventral pathway with normal motion perception in the dorsal pathway. These electrophysiological findings were consistent with lesions in the ventral pathway that were detected by clinical and neuroimaging findings. Therefore, CS-VEPs and ERPs with color and motion discrimination tasks are useful methods for assessing the functional changes of visual recognition such as visual agnosia.