Generalized Zero-Shot Learning through Similarity Distribution Matching

Simple item page
dc.contributor.advisorShrivastava, Anshumali
dc.creatorDaghaghi, Shabnam
dc.date.accessioned2022-10-05T21:44:55Z
dc.date.available2022-10-05T21:44:55Z
dc.date.created2022-05
dc.date.issued2022-02-18
dc.date.submittedMay 2022
dc.date.updated2022-10-05T21:44:56Z
dc.description.abstractRecent advances in supervised learning methods in vision, specifically deep learning frameworks, are primarily built on the abundance of labeled images. However, image labeling is a laborious task, therefore many visual categories are unlabeled or even unavailable. Zero-Shot Learning (ZSL) deals with classifying unseen visual categories that have no samples during training phase. In particular, ZSL is a classification task where some classes referred to as unseen classes have no training images. Instead, we only have side information about seen and unseen classes, often in the form of semantic or descriptive attributes. Lack of training images from a set of classes restricts the use of standard classification techniques and losses, including the widespread cross-entropy loss. We introduce a novel Similarity Distribution Matching Network (SDM-Net) which is a standard fully connected neural-network architecture with non-trainable penultimate layer consisting of class attributes. The output layer of SDM-Net consists of both seen and unseen classes. To enable zero-shot learning, during training, we regularize the model such that the predicted distribution of unseen class is close in KL divergence to the distribution of similarities between the correct seen class and all the unseen classes. We evaluate the proposed model on five benchmark datasets for zero-shot learning, AwA1, AwA2, aPY, SUN and CUB datasets. We show that, despite the simplicity, our approach achieves competitive performance with state-of-the-art methods in Generalized-ZSL setting for all of these datasets.
dc.format.mimetypeapplication/pdf
dc.identifier.citationDaghaghi, Shabnam. "Generalized Zero-Shot Learning through Similarity Distribution Matching." (2022) Master’s Thesis, Rice University. <a href="https://hdl.handle.net/1911/113538">https://hdl.handle.net/1911/113538</a>.
dc.identifier.urihttps://hdl.handle.net/1911/113538
dc.language.isoeng
dc.rightsCopyright is held by the author, unless otherwise indicated. Permission to reuse, publish, or reproduce the work beyond the bounds of fair use or other exemptions to copyright law must be obtained from the copyright holder.
dc.subjectGeneralized Zero-Shot Learning
dc.subjectImage Classification
dc.subjectSemantic Similarity
dc.subjectKL Divergence
dc.titleGeneralized Zero-Shot Learning through Similarity Distribution Matching
dc.typeThesis
dc.type.materialText
thesis.degree.departmentElectrical and Computer Engineering
thesis.degree.disciplineEngineering
thesis.degree.grantorRice University
thesis.degree.levelMasters
thesis.degree.nameMaster of Science
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
DAGHAGHI-DOCUMENT-2022.pdf
Size:
2.15 MB
Format:
Adobe Portable Document Format
Download
License bundle
Now showing 1 - 2 of 2
No Thumbnail Available
Name:
PROQUEST_LICENSE.txt
Size:
5.85 KB
Format:
Plain Text
Description:
Download
No Thumbnail Available
Name:
LICENSE.txt
Size:
2.61 KB
Format:
Plain Text
Description:
Download
Collections
Rice University Electronic Theses and Dissertations