Diverse task-driven modeling of macaque V4 reveals functional specialization towards semantic tasks

Simple item page
dc.citation.articleNumbere1012056en_US
dc.citation.issueNumber5en_US
dc.citation.journalTitlePLOS Computational Biologyen_US
dc.citation.volumeNumber20en_US
dc.contributor.authorCadena, Santiago A.en_US
dc.contributor.authorWilleke, Konstantin F.en_US
dc.contributor.authorRestivo, Kellien_US
dc.contributor.authorDenfield, Georgeen_US
dc.contributor.authorSinz, Fabian H.en_US
dc.contributor.authorBethge, Matthiasen_US
dc.contributor.authorTolias, Andreas S.en_US
dc.contributor.authorEcker, Alexander S.en_US
dc.date.accessioned2024-08-07T19:15:01Zen_US
dc.date.available2024-08-07T19:15:01Zen_US
dc.date.issued2024en_US
dc.description.abstractResponses to natural stimuli in area V4—a mid-level area of the visual ventral stream—are well predicted by features from convolutional neural networks (CNNs) trained on image classification. This result has been taken as evidence for the functional role of V4 in object classification. However, we currently do not know if and to what extent V4 plays a role in solving other computational objectives. Here, we investigated normative accounts of V4 (and V1 for comparison) by predicting macaque single-neuron responses to natural images from the representations extracted by 23 CNNs trained on different computer vision tasks including semantic, geometric, 2D, and 3D types of tasks. We found that V4 was best predicted by semantic classification features and exhibited high task selectivity, while the choice of task was less consequential to V1 performance. Consistent with traditional characterizations of V4 function that show its high-dimensional tuning to various 2D and 3D stimulus directions, we found that diverse non-semantic tasks explained aspects of V4 function that are not captured by individual semantic tasks. Nevertheless, jointly considering the features of a pair of semantic classification tasks was sufficient to yield one of our top V4 models, solidifying V4’s main functional role in semantic processing and suggesting that V4’s selectivity to 2D or 3D stimulus properties found by electrophysiologists can result from semantic functional goals.en_US
dc.identifier.citationCadena, S. A., Willeke, K. F., Restivo, K., Denfield, G., Sinz, F. H., Bethge, M., Tolias, A. S., & Ecker, A. S. (2024). Diverse task-driven modeling of macaque V4 reveals functional specialization towards semantic tasks. PLOS Computational Biology, 20(5), e1012056. https://doi.org/10.1371/journal.pcbi.1012056en_US
dc.identifier.digitaljournal-pcbi-1012056en_US
dc.identifier.doihttps://doi.org/10.1371/journal.pcbi.1012056en_US
dc.identifier.urihttps://hdl.handle.net/1911/117609en_US
dc.language.isoengen_US
dc.publisherPublic Library of Scienceen_US
dc.rightsExcept where otherwise noted, this work is licensed under a Creative Commons Attribution (CC BY) license.  Permission to reuse, publish, or reproduce the work beyond the terms of the license or beyond the bounds of fair use or other exemptions to copyright law must be obtained from the copyright holder.en_US
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/en_US
dc.titleDiverse task-driven modeling of macaque V4 reveals functional specialization towards semantic tasksen_US
dc.typeJournal articleen_US
dc.type.dcmiTexten_US
dc.type.publicationpublisher versionen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
journal-pcbi-1012056.pdf
Size:
2.47 MB
Format:
Adobe Portable Document Format
Download
Collections
Faculty Publications
ECE Publications