Publication Date:
2008-03-07
Description:
A challenging goal in neuroscience is to be able to read out, or decode, mental content from brain activity. Recent functional magnetic resonance imaging (fMRI) studies have decoded orientation, position and object category from activity in visual cortex. However, these studies typically used relatively simple stimuli (for example, gratings) or images drawn from fixed categories (for example, faces, houses), and decoding was based on previous measurements of brain activity evoked by those same stimuli or categories. To overcome these limitations, here we develop a decoding method based on quantitative receptive-field models that characterize the relationship between visual stimuli and fMRI activity in early visual areas. These models describe the tuning of individual voxels for space, orientation and spatial frequency, and are estimated directly from responses evoked by natural images. We show that these receptive-field models make it possible to identify, from a large set of completely novel natural images, which specific image was seen by an observer. Identification is not a mere consequence of the retinotopic organization of visual areas; simpler receptive-field models that describe only spatial tuning yield much poorer identification performance. Our results suggest that it may soon be possible to reconstruct a picture of a person's visual experience from measurements of brain activity alone.〈br /〉〈br /〉〈a href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3556484/" target="_blank"〉〈img src="https://static.pubmed.gov/portal/portal3rc.fcgi/4089621/img/3977009" border="0"〉〈/a〉 〈a href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3556484/" target="_blank"〉This paper as free author manuscript - peer-reviewed and accepted for publication〈/a〉〈br /〉〈br /〉〈span class="detail_caption"〉Notes: 〈/span〉Kay, Kendrick N -- Naselaris, Thomas -- Prenger, Ryan J -- Gallant, Jack L -- R01 EY019684/EY/NEI NIH HHS/ -- England -- Nature. 2008 Mar 20;452(7185):352-5. doi: 10.1038/nature06713. Epub 2008 Mar 5.〈br /〉〈span class="detail_caption"〉Author address: 〈/span〉Department of Psychology, University of California, Berkeley, California 94720, USA.〈br /〉〈span class="detail_caption"〉Record origin:〈/span〉 〈a href="http://www.ncbi.nlm.nih.gov/pubmed/18322462" target="_blank"〉PubMed〈/a〉
Keywords:
Brain/*physiology
;
Brain Mapping/*methods
;
Humans
;
Image Processing, Computer-Assisted
;
Magnetic Resonance Imaging
;
Nature
;
Photic Stimulation
;
Photography
;
Research Design
;
Visual Perception/*physiology
Print ISSN:
0028-0836
Electronic ISSN:
1476-4687
Topics:
Biology
,
Chemistry and Pharmacology
,
Medicine
,
Natural Sciences in General
,
Physics
Permalink
