Repository logo
 

fMRI Analysis-by-Synthesis Reveals a Dorsal Hierarchy That Extracts Surface Slant.


Change log

Authors

Ban, Hiroshi 
Welchman, Andrew E 

Abstract

The brain's skill in estimating the 3-D orientation of viewed surfaces supports a range of behaviors, from placing an object on a nearby table, to planning the best route when hill walking. This ability relies on integrating depth signals across extensive regions of space that exceed the receptive fields of early sensory neurons. Although hierarchical selection and pooling is central to understanding of the ventral visual pathway, the successive operations in the dorsal stream are poorly understood. Here we use computational modeling of human fMRI signals to probe the computations that extract 3-D surface orientation from binocular disparity. To understand how representations evolve across the hierarchy, we developed an inference approach using a series of generative models to explain the empirical fMRI data in different cortical areas. Specifically, we simulated the responses of candidate visual processing algorithms and tested how well they explained fMRI responses. Thereby we demonstrate a hierarchical refinement of visual representations moving from the representation of edges and figure-ground segmentation (V1, V2) to spatially extensive disparity gradients in V3A. We show that responses in V3A are little affected by low-level image covariates, and have a partial tolerance to the overall depth position. Finally, we show that responses in V3A parallel perceptual judgments of slant. This reveals a relatively short computational hierarchy that captures key information about the 3-D structure of nearby surfaces, and more generally demonstrates an analysis approach that may be of merit in a diverse range of brain imaging domains.

Description

Keywords

3-D vision, binocular disparity, fMRI, slant, Analysis of Variance, Brain, Cues, Depth Perception, Discrimination, Psychological, Female, Humans, Image Processing, Computer-Assisted, Magnetic Resonance Imaging, Male, Orientation, Oxygen, Photic Stimulation, Psychophysics, Regression Analysis, Reproducibility of Results, Students, Universities, Vision Disparity, Visual Pathways

Journal Title

J Neurosci

Conference Name

Journal ISSN

0270-6474
1529-2401

Volume Title

35

Publisher

Society for Neuroscience
Sponsorship
Wellcome Trust (095183/Z/10/Z)
This project was supported by the Wellcome Trust (095183/Z/ 10/Z) and the Japan Society for the Promotion of Science (H22.290 and KAKENHI 26870911).