Cache-Efficient Graph Algorithms for Near Neighbor Search
| dc.contributor.advisor | Shrivastava, Anshumali | |
| dc.creator | Coleman, Ben | |
| dc.date.accessioned | 2021-11-04T13:59:41Z | |
| dc.date.available | 2022-06-01T05:01:12Z | |
| dc.date.created | 2021-12 | |
| dc.date.issued | 2021-11-01 | |
| dc.date.submitted | December 2021 | |
| dc.date.updated | 2021-11-04T13:59:42Z | |
| dc.description.abstract | Graph search has recently become one of the most successful algorithmic trends for near neighbor search. Several of the most popular and empirically successful algorithms are, at their core, a simple walk along a pruned near neighbor graph. Such methods consistently outperform other approaches and are a central component of industrial- scale information retrieval and recommendation systems. However, graph algorithms often suffer from issues related to the memory access pattern of graph traversal. Our measurements show that near neighbor search is no exception to this rule: popular graph indices have poor cache performance and rely on complex heuristics with a large memory cost. To address this problem, we apply graph reordering methods to near neighbor graphs. Graph reordering is a memory layout optimization that groups commonly-accessed nodes together in memory. We present exhaustive experiments that apply several reordering algorithms to the hierarchical navigable small-world (HNSW) graph, and we analyze the algorithms under the ideal cache model. We find that reordering improves the query time by up to 40%. We also demonstrate that popular heuristics can be replaced by simpler alternatives with no performance loss, and we show that the time needed to reorder the graph is negligible compared to the time required to construct the index. | |
| dc.embargo.terms | 2022-06-01 | |
| dc.format.mimetype | application/pdf | |
| dc.identifier.citation | Coleman, Ben. "Cache-Efficient Graph Algorithms for Near Neighbor Search." (2021) Master’s Thesis, Rice University. <a href="https://hdl.handle.net/1911/111627">https://hdl.handle.net/1911/111627</a>. | |
| dc.identifier.uri | https://hdl.handle.net/1911/111627 | |
| dc.language.iso | eng | |
| dc.rights | Copyright is held by the author, unless otherwise indicated. Permission to reuse, publish, or reproduce the work beyond the bounds of fair use or other exemptions to copyright law must be obtained from the copyright holder. | |
| dc.subject | near neighbor search | |
| dc.subject | graphs | |
| dc.subject | caching | |
| dc.title | Cache-Efficient Graph Algorithms for Near Neighbor Search | |
| dc.type | Thesis | |
| dc.type.material | Text | |
| thesis.degree.department | Electrical and Computer Engineering | |
| thesis.degree.discipline | Engineering | |
| thesis.degree.grantor | Rice University | |
| thesis.degree.level | Masters | |
| thesis.degree.name | Master of Science |
Files
Original bundle
1 - 1 of 1