The Invariance Hypothesis Implies Domain-Specific Regions in Visual Cortex

Joel Z Leibo, Qianli Liao, Fabio Anselmi and Tomaso Poggio

PLOS Computational Biology, 2015, vol. 11, issue 10, 1-29

Abstract: Is visual cortex made up of general-purpose information processing machinery, or does it consist of a collection of specialized modules? If prior knowledge, acquired from learning a set of objects is only transferable to new objects that share properties with the old, then the recognition system’s optimal organization must be one containing specialized modules for different object classes. Our analysis starts from a premise we call the invariance hypothesis: that the computational goal of the ventral stream is to compute an invariant-to-transformations and discriminative signature for recognition. The key condition enabling approximate transfer of invariance without sacrificing discriminability turns out to be that the learned and novel objects transform similarly. This implies that the optimal recognition system must contain subsystems trained only with data from similarly-transforming objects and suggests a novel interpretation of domain-specific regions like the fusiform face area (FFA). Furthermore, we can define an index of transformation-compatibility, computable from videos, that can be combined with information about the statistics of natural vision to yield predictions for which object categories ought to have domain-specific regions in agreement with the available data. The result is a unifying account linking the large literature on view-based recognition with the wealth of experimental evidence concerning domain-specific regions.Author Summary: Domain-specific regions, like the fusiform face area, are a prominent feature of ventral visual cortex organization. Despite decades of interest from a large number of investigators employing diverse methods, there has been surprisingly little theoretical work on “why” the ventral stream may adopt this modular organization. In this study we propose a computational account of the role played by domain-specific regions in ventral stream function. It follows from a new theoretical analysis of the recognition problem which highlights the importance of building representations that are robust to class-specific transformations. These results provide a unifying account linking neuroimaging and neuropsychology-based ideas of domain-specific regions to the psychophysics and electrophysiology-oriented literature on view-based object recognition and invariance.

Date: 2015
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1004390 (text/html)
https://journals.plos.org/ploscompbiol/article/fil ... 04390&type=printable (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:plo:pcbi00:1004390

DOI: 10.1371/journal.pcbi.1004390

Access Statistics for this article

More articles in PLOS Computational Biology from Public Library of Science
Bibliographic data for series maintained by ploscompbiol ().