Near-Optimal Hashing Algorithms for Approximate Nearest Neighbor in High Dimensions

Authors:
Alexandr Andoni;Piotr Indyk
Affiliations:
MIT, USA;MIT, USA
Venue:
FOCS '06 Proceedings of the 47th Annual IEEE Symposium on Foundations of Computer Science
Year:
2006

Citing 0
Cited 93

Combining stroke-based and selection-based relevance feedback for content-based image retrieval

Proceedings of the 15th international conference on Multimedia
Multi-probe LSH: efficient indexing for high-dimensional similarity search

VLDB '07 Proceedings of the 33rd international conference on Very large data bases
Technical perspective: finding a good neighbor, near and fast

Communications of the ACM - 50th anniversary issue: 1958 - 2008
Near-optimal hashing algorithms for approximate nearest neighbor in high dimensions

Communications of the ACM - 50th anniversary issue: 1958 - 2008
Disorder inequality: a combinatorial approach to nearest neighbor search

WSDM '08 Proceedings of the 2008 International Conference on Web Search and Data Mining
Nearest neighbor search methods for handshape recognition

Proceedings of the 1st international conference on PErvasive Technologies Related to Assistive Environments
SpotSigs: robust and efficient near duplicate detection in large web collections

Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
Locality sensitive hash functions based on concomitant rank order statistics

Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining
Improving Evolutionary Algorithms with Scouting: High---Dimensional Problems

ICAISC '08 Proceedings of the 9th international conference on Artificial Intelligence and Soft Computing
RLTE: Reinforcement Learning for Traffic-Engineering

AIMS '08 Proceedings of the 2nd international conference on Autonomous Infrastructure, Management and Security: Resilient Networks and Services
Client-Friendly Classification over Random Hyperplane Hashes

ECML PKDD '08 Proceedings of the European conference on Machine Learning and Knowledge Discovery in Databases - Part II
Unsupervised Classifier Selection Based on Two-Sample Test

DS '08 Proceedings of the 11th International Conference on Discovery Science
Approximate Retrieval with HiPeR: Application to VA-Hierarchies

MMM '09 Proceedings of the 15th International Multimedia Modeling Conference on Advances in Multimedia Modeling
Principal Component Hashing: An Accelerated Approximate Nearest Neighbor Search

PSIVT '09 Proceedings of the 3rd Pacific Rim Symposium on Advances in Image and Video Technology
Distributed similarity search in high dimensions using locality sensitive hashing

Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology
Speed up interactive image retrieval

The VLDB Journal — The International Journal on Very Large Data Bases
Semantic hashing

International Journal of Approximate Reasoning
Quality and efficiency in high dimensional nearest neighbor search

Proceedings of the 2009 ACM SIGMOD International Conference on Management of data
Searching High-Dimensional Neighbours: CPU-Based Tailored Data-Structures Versus GPU-Based Brute-Force Method

MIRAGE '09 Proceedings of the 4th International Conference on Computer Vision/Computer Graphics CollaborationTechniques
CompositeMap: a novel framework for music similarity measure

Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
The Closest Pair Problem under the Hamming Metric

COCOON '09 Proceedings of the 15th Annual International Conference on Computing and Combinatorics
Multimodal people detection and tracking in crowded scenes

AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 3
Comprehensive query-dependent fusion using regression-on-folksonomies: a case study of multimodal music search

MM '09 Proceedings of the 17th ACM international conference on Multimedia
CompositeMap: a novel music similarity measure for personalized multimodal music search

MM '09 Proceedings of the 17th ACM international conference on Multimedia
Combinatorial Framework for Similarity Search

SISAP '09 Proceedings of the 2009 Second International Workshop on Similarity Search and Applications
LORD: a locality-based Distributed data sharing system for highly dense and dynamic MANETs

INFOCOM'09 Proceedings of the 28th IEEE international conference on Computer Communications Workshops
HARRA: fast iterative hashed record linkage for large-scale data collections

Proceedings of the 13th International Conference on Extending Database Technology
An improved algorithm finding nearest neighbor using Kd-trees

LATIN'08 Proceedings of the 8th Latin American conference on Theoretical informatics
Efficient and accurate nearest neighbor and closest pair search in high-dimensional space

ACM Transactions on Database Systems (TODS)
Similarity search and locality sensitive hashing using ternary content addressable memories

Proceedings of the 2010 ACM SIGMOD International Conference on Management of data
Locality sensitive hashing: A comparison of hash function types and querying mechanisms

Pattern Recognition Letters
Distributed locality sensitivity hashing

CCNC'10 Proceedings of the 7th IEEE conference on Consumer communications and networking conference
Self-taught hashing for fast similarity search

Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
Bucketing coding and information theory for the statistical high-dimensional nearest-neighbor problem

IEEE Transactions on Information Theory
Scalable and systematic detection of buggy inconsistencies in source code

Proceedings of the ACM international conference on Object oriented programming systems languages and applications
An analysis of random projection for changeable and privacy-preserving biometric verification

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Hashing-based approaches to spelling correction of personal names

EMNLP '10 Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing
Efficient incremental near duplicate detection based on locality sensitive hashing

DEXA'10 Proceedings of the 21st international conference on Database and expert systems applications: Part I
Computational topology

Algorithms and theory of computation handbook
iPoc: a polar coordinate based indexing method for nearest neighbor search in high dimensional space

WAIM'10 Proceedings of the 11th international conference on Web-age information management
Fast approximate nearest neighbor methods for non-Euclidean manifolds with applications to human activity analysis in videos

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part II
What does classifying more than 10,000 image categories tell us?

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part V
Optimal hash functions for approximate matches on the n-cube

IEEE Transactions on Information Theory
Error-correcting output hashing in fast similarity search

ICIMCS '10 Proceedings of the Second International Conference on Internet Multimedia Computing and Service
Learning reconfigurable hashing for diverse semantics

Proceedings of the 1st ACM International Conference on Multimedia Retrieval
Accurate content-based video copy detection with efficient feature indexing

Proceedings of the 1st ACM International Conference on Multimedia Retrieval
Comparing distributions and shapes using the kernel distance

Proceedings of the twenty-seventh annual symposium on Computational geometry
Composite hashing with multiple information sources

Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval
Fast approximate similarity search based on degree-reduced neighborhood graphs

Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining
The MOPED framework: Object recognition and pose estimation for manipulation

International Journal of Robotics Research
Efficient approximate similarity search using random projection learning

WAIM'11 Proceedings of the 12th international conference on Web-age information management
On noise-tolerant learning of sparse parities and related problems

ALT'11 Proceedings of the 22nd international conference on Algorithmic learning theory
Hypergraph spectral hashing for similarity search of social image

MM '11 Proceedings of the 19th ACM international conference on Multimedia
Fast GPU-based locality sensitive hashing for k-nearest neighbor computation

Proceedings of the 19th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems
Adaptive ensemble classification in p2p networks

DASFAA'10 Proceedings of the 15th international conference on Database Systems for Advanced Applications - Volume Part I
Approximate nearest neighbor search for low dimensional queries

Proceedings of the twenty-second annual ACM-SIAM symposium on Discrete Algorithms
Content distribution and copyright authentication based on combined indexing and watermarking

Multimedia Tools and Applications
A unified approach to learning task-specific bit vector representations for fast nearest neighbor search

Proceedings of the 21st international conference on World Wide Web
Efficient multi-camera vehicle detection, tracking, and identification in a tunnel surveillance application

Computer Vision and Image Understanding
A fast audio similarity retrieval method for millions of music tracks

Multimedia Tools and Applications
Learning hash functions for cross-view similarity search

IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Two
Leveraging unlabeled data to scale blocking for record linkage

IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Three
Nearest-Neighbor based Metric Functions for indoor scene recognition

Computer Vision and Image Understanding
Towards enabling outlier detection in large, high dimensional data warehouses

SSDBM'12 Proceedings of the 24th international conference on Scientific and Statistical Database Management
Scalable distributed algorithm for approximate nearest neighbor search problem in high dimensional general metric spaces

SISAP'12 Proceedings of the 5th international conference on Similarity Search and Applications
A survey on unsupervised outlier detection in high-dimensional numerical data

Statistical Analysis and Data Mining
Spherical lsh for approximate nearest neighbor search on unit hypersphere

WADS'07 Proceedings of the 10th international conference on Algorithms and Data Structures
Rank hash similarity for fast similarity search

Information Processing and Management: an International Journal
Query specific fusion for image retrieval

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part II
Multidimensional spectral hashing

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part V
Active hashing and its application to image and text retrieval

Data Mining and Knowledge Discovery
An efficient quasi-identifier index based approach for privacy preservation over incremental data sets on cloud

Journal of Computer and System Sciences
Dual local consistency hashing with discriminative projections selection

Signal Processing
AdRob: examining the landscape and impact of android application plagiarism

Proceeding of the 11th annual international conference on Mobile systems, applications, and services
Inter-media hashing for large-scale retrieval from heterogeneous data sources

Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data
LSH-based large scale chinese calligraphic character recognition

Proceedings of the 13th ACM/IEEE-CS joint conference on Digital libraries
Using file relationships in malware classification

DIMVA'12 Proceedings of the 9th international conference on Detection of Intrusions and Malware, and Vulnerability Assessment
Effective hashing for large-scale multimedia search

Proceedings of the 2013 Sigmod/PODS Ph.D. symposium on PhD symposium
Semantic hashing using tags and topic modeling

Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
Comparing apples to oranges: a scalable solution with heterogeneous hashing

Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining
An information-aware QoE-centric mobile video cache

Proceedings of the 19th annual international conference on Mobile computing & networking
Topology preserving hashing for similarity search

Proceedings of the 21st ACM international conference on Multimedia
Towards efficient sparse coding for scalable image annotation

Proceedings of the 21st ACM international conference on Multimedia
Fitted spectral hashing

Proceedings of the 21st ACM international conference on Multimedia
Super-EGO: fast multi-dimensional similarity join

The VLDB Journal — The International Journal on Very Large Data Bases
Searching similar segments over textual event sequences

Proceedings of the 22nd ACM international conference on Conference on information & knowledge management
Hypergraph Spectral Hashing for image retrieval with heterogeneous social contexts

Neurocomputing
Scalable multimedia content analysis on parallel platforms using python

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Enhancing video accessibility and availability using information-bound references

Proceedings of the ninth ACM conference on Emerging networking experiments and technologies
Parametric local multimodal hashing for cross-view similarity search

IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
DIMO: distributed index for matching multimedia objects using MapReduce

Proceedings of the 5th ACM Multimedia Systems Conference
ISOMER: integrated selection, partitioning, and placement methodology for reconfigurable architectures

Proceedings of the International Conference on Computer-Aided Design
Recognizing activities in multiple views with fusion of frame judgments

Image and Vision Computing

Quantified Score

Hi-index	0.12

Visualization

Abstract

We present an algorithm for the c-approximate nearest neighbor problem in a d-dimensional Euclidean space, achieving query time of O\left( {dn^{1/c^2+ o(1)} } \right) and space O\left( {dn + n^{1 + 1/c^2+ o(1)} } \right). This almost matches the lower bound for hashing-based algorithm recently obtained in [27]. We also obtain a space-efficient version of the algorithm, which uses dn+n log^{O(1)} n space, with a query time of dn^{O(1/c^2 )}. Finally, we discuss practical variants of the algorithms that utilize fast bounded-distance decoders for the Leech Lattice.