Diverse task-driven modeling of macaque V4 reveals functional specialization towards semantic tasks

Simple item page
dc.citation.articleNumbere1012056
dc.citation.issueNumber5
dc.citation.journalTitlePLOS Computational Biology
dc.citation.volumeNumber20
dc.contributor.authorCadena, Santiago A.
dc.contributor.authorWilleke, Konstantin F.
dc.contributor.authorRestivo, Kelli
dc.contributor.authorDenfield, George
dc.contributor.authorSinz, Fabian H.
dc.contributor.authorBethge, Matthias
dc.contributor.authorTolias, Andreas S.
dc.contributor.authorEcker, Alexander S.
dc.date.accessioned2024-08-07T19:15:01Z
dc.date.available2024-08-07T19:15:01Z
dc.date.issued2024
dc.description.abstractResponses to natural stimuli in area V4—a mid-level area of the visual ventral stream—are well predicted by features from convolutional neural networks (CNNs) trained on image classification. This result has been taken as evidence for the functional role of V4 in object classification. However, we currently do not know if and to what extent V4 plays a role in solving other computational objectives. Here, we investigated normative accounts of V4 (and V1 for comparison) by predicting macaque single-neuron responses to natural images from the representations extracted by 23 CNNs trained on different computer vision tasks including semantic, geometric, 2D, and 3D types of tasks. We found that V4 was best predicted by semantic classification features and exhibited high task selectivity, while the choice of task was less consequential to V1 performance. Consistent with traditional characterizations of V4 function that show its high-dimensional tuning to various 2D and 3D stimulus directions, we found that diverse non-semantic tasks explained aspects of V4 function that are not captured by individual semantic tasks. Nevertheless, jointly considering the features of a pair of semantic classification tasks was sufficient to yield one of our top V4 models, solidifying V4’s main functional role in semantic processing and suggesting that V4’s selectivity to 2D or 3D stimulus properties found by electrophysiologists can result from semantic functional goals.
dc.identifier.citationCadena, S. A., Willeke, K. F., Restivo, K., Denfield, G., Sinz, F. H., Bethge, M., Tolias, A. S., & Ecker, A. S. (2024). Diverse task-driven modeling of macaque V4 reveals functional specialization towards semantic tasks. PLOS Computational Biology, 20(5), e1012056. https://doi.org/10.1371/journal.pcbi.1012056
dc.identifier.digitaljournal-pcbi-1012056
dc.identifier.doihttps://doi.org/10.1371/journal.pcbi.1012056
dc.identifier.urihttps://hdl.handle.net/1911/117609
dc.language.isoeng
dc.publisherPublic Library of Science
dc.rightsExcept where otherwise noted, this work is licensed under a Creative Commons Attribution (CC BY) license.  Permission to reuse, publish, or reproduce the work beyond the terms of the license or beyond the bounds of fair use or other exemptions to copyright law must be obtained from the copyright holder.
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.titleDiverse task-driven modeling of macaque V4 reveals functional specialization towards semantic tasks
dc.typeJournal article
dc.type.dcmiText
dc.type.publicationpublisher version
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
journal-pcbi-1012056.pdf
Size:
2.47 MB
Format:
Adobe Portable Document Format
Download
Collections
Faculty Publications
ECE Publications