A Fast and Efficient Sift Detector Using The Mobile GPU

Abstract

Emerging mobile applications, such as augmented reality, demand robust feature detection at high frame rates. We present an implementation of the popular Scale-Invariant Feature Transform (SIFT) feature detection algorithm that incorporates the powerful graphics processing unit (GPU) in mobile devices. Where the usual GPU methods are inefficient on mobile hardware, we propose a heterogeneous dataflow scheme. By methodically partitioning the computation, compressing the data for memory transfers, and taking into account the unique challenges that arise out of the mobile GPU, we are able to achieve a speedup of 4-7x over an optimized CPU version, and a 6.4x speedup over a published GPU implementation. Additionally, we reduce energy consumption by 87 percent per image. We achieve near-realtime detection without compromising the original algorithm.

Description
Advisor
Degree
Type
Conference paper
Keywords
computer vision, mobile computing, feature detection, graphics processing unit (GPU), OpenGL for Embedded Systems (OpenGL ES)
Citation

B. Rister, G. Wang, M. Wu and J. R. Cavallaro, "A Fast and Efficient Sift Detector Using The Mobile GPU," 2013.

Has part(s)
Forms part of
Rights
Link to license
Citable link to this page
Collections