A mixture of sparse coding models explaining properties of face neurons related to holistic and parts-based processing

Show full item record



Permalink

http://hdl.handle.net/10138/218285

Citation

Hosoya , H & Hyvärinen , A 2017 , ' A mixture of sparse coding models explaining properties of face neurons related to holistic and parts-based processing ' , PLoS Computational Biology , vol. 13 , no. 7 , 1005667 . https://doi.org/10.1371/journal.pcbi.1005667

Title: A mixture of sparse coding models explaining properties of face neurons related to holistic and parts-based processing
Author: Hosoya, Haruo; Hyvärinen, Aapo
Contributor: University of Helsinki, Department of Computer Science
Date: 2017-07
Language: eng
Number of pages: 27
Belongs to series: PLoS Computational Biology
ISSN: 1553-734X
URI: http://hdl.handle.net/10138/218285
Abstract: Experimental studies have revealed evidence of both parts-based and holistic representations of objects and faces in the primate visual system. However, it is still a mystery how such seemingly contradictory types of processing can coexist within a single system. Here, we propose a novel theory called mixture of sparse coding models, inspired by the formation of category-specific subregions in the inferotemporal (IT) cortex. We developed a hierarchical network that constructed a mixture of two sparse coding submodels on top of a simple Gabor analysis. The submodels were each trained with face or non-face object images, which resulted in separate representations of facial parts and object parts. Importantly, evoked neural activities were modeled by Bayesian inference, which had a top-down explaining-away effect that enabled recognition of an individual part to depend strongly on the category of the whole input. We show that this explaining-away effect was indeed crucial for the units in the face submodel to exhibit significant selectivity to face images over object images in a similar way to actual face-selective neurons in the macaque IT cortex. Furthermore, the model explained, qualitatively and quantitatively, several tuning properties to facial features found in the middle patch of face processing in IT as documented by Freiwald, Tsao, and Livingstone (2009). These included, in particular, tuning to only a small number of facial features that were often related to geometrically large parts like face outline and hair, preference and anti-preference of extreme facial features (e.g., very large/small inter-eye distance), and reduction of the gain of feature tuning for partial face stimuli compared to whole face stimuli. Thus, we hypothesize that the coding principle of facial features in the middle patch of face processing in the macaque IT cortex may be closely related to mixture of sparse coding models.
Subject: RECEPTIVE-FIELD PROPERTIES
MACAQUE TEMPORAL-LOBE
NATURAL IMAGES
VISUAL-CORTEX
RECOGNITION
EMERGENCE
PATCHES
STATISTICS
PERCEPTION
OBJECTS
1182 Biochemistry, cell and molecular biology
Rights:


Files in this item

Total number of downloads: Loading...

Files Size Format View
journal.pcbi.1005667.pdf 15.19Mb PDF View/Open

This item appears in the following Collection(s)

Show full item record