The multi-class metric problem in nearest neighbour discrimination rules
Pattern Recognition
Machine learning, neural and statistical classification
Machine learning, neural and statistical classification
Efficient Pattern Recognition Using a New Transformation Distance
Advances in Neural Information Processing Systems 5, [NIPS Conference]
Similarity Metric Learning for a Variable-Kernel Classifier
Similarity Metric Learning for a Variable-Kernel Classifier
Data Compression and Local Metrics for Nearest Neighbor Classification
IEEE Transactions on Pattern Analysis and Machine Intelligence
Hierarchical Discriminant Analysis for Image Retrieval
IEEE Transactions on Pattern Analysis and Machine Intelligence
Feature extraction through LOCOCODE
Neural Computation
Olfactory Classification via Interpoint Distance Analysis
IEEE Transactions on Pattern Analysis and Machine Intelligence
Lazy learning: a logical method for supervised learning
New learning paradigms in soft computing
Offline General Handwritten Word Recognition Using an Approximate BEAM Matching Algorithm
IEEE Transactions on Pattern Analysis and Machine Intelligence
Locally Adaptive Metric Nearest-Neighbor Classification
IEEE Transactions on Pattern Analysis and Machine Intelligence
Learning of Variability for Invariant Statistical Pattern Recognition
EMCL '01 Proceedings of the 12th European Conference on Machine Learning
Independent Feature Analysis for Image Retrieval
MLDM '99 Proceedings of the First International Workshop on Machine Learning and Data Mining in Pattern Recognition
Concepts Learning with Fuzzy Clustering and Relevance Feedback
MLDM '01 Proceedings of the Second International Workshop on Machine Learning and Data Mining in Pattern Recognition
Similarity Search in High Dimensions via Hashing
VLDB '99 Proceedings of the 25th International Conference on Very Large Data Bases
Comparing Linear Discriminant Analysis and Support Vector Machines
ADVIS '02 Proceedings of the Second International Conference on Advances in Information Systems
A Symmetric Nearest Neighbor Learning Rule
EWCBR '00 Proceedings of the 5th European Workshop on Advances in Case-Based Reasoning
Instance Guided Rule Induction
DS '98 Proceedings of the First International Conference on Discovery Science
Choosing k for two-class nearest neighbour classifiers with unbalanced classes
Pattern Recognition Letters
Non-linear dimensionality reduction techniques for classification and visualization
Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining
Data mining tasks and methods: Classification: nearest-neighbor approaches
Handbook of data mining and knowledge discovery
Multi-class relevance feedback content-based image retrieval
Computer Vision and Image Understanding
Nonparametric discriminant analysis and nearest neighbor classification
Pattern Recognition Letters
Fast k-Nearest Neighbor Classification Using Cluster-Based Trees
IEEE Transactions on Pattern Analysis and Machine Intelligence
Adaptive Quasiconformal Kernel Nearest Neighbor Classification
IEEE Transactions on Pattern Analysis and Machine Intelligence
Integrated Sensing and Processing Decision Trees
IEEE Transactions on Pattern Analysis and Machine Intelligence
Locally linear metric adaptation for semi-supervised clustering
ICML '04 Proceedings of the twenty-first international conference on Machine learning
MBNR: Case-Based Reasoning with Local Feature Weighting by Neural Network
Applied Intelligence
Proceedings of the 2005 ACM SIGMOD international conference on Management of data
Statistics and Computing
On Visualization and Aggregation of Nearest Neighbor Classifiers
IEEE Transactions on Pattern Analysis and Machine Intelligence
Separating Style and Content with Bilinear Models
Neural Computation
A nearest neighbor approach to letter recognition
Proceedings of the 44th annual Southeast regional conference
Improving nearest neighbor classification with cam weighted distance
Pattern Recognition
Prototype selection for dissimilarity-based classifiers
Pattern Recognition
Classification of gene-expression data: The manifold-based metric learning way
Pattern Recognition
Improving nearest neighbor rule with a simple adaptive distance measure
Pattern Recognition Letters
Pattern Recognition Letters
ACM Transactions on Database Systems (TODS)
New Algorithms for Efficient High-Dimensional Nonparametric Classification
The Journal of Machine Learning Research
Dimensionality Reduction of Multimodal Labeled Data by Local Fisher Discriminant Analysis
The Journal of Machine Learning Research
Toward Exploratory Test-Instance-Centered Diagnosis in High-Dimensional Classification
IEEE Transactions on Knowledge and Data Engineering
Information-theoretic metric learning
Proceedings of the 24th international conference on Machine learning
Optimal dimensionality of metric space for classification
Proceedings of the 24th international conference on Machine learning
Data-Dependent Kernel Machines for Microarray Data Classification
IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Using Biologically Inspired Features for Face Processing
International Journal of Computer Vision
Metric learning by discriminant neighborhood embedding
Pattern Recognition
An efficient weighted nearest neighbour classifier using vertical data representation
International Journal of Business Intelligence and Data Mining
Feature Extraction for Dynamic Integration of Classifiers
Fundamenta Informaticae
Learning dissimilarities by ranking: from SDP to QP
Proceedings of the 25th international conference on Machine learning
Fast solvers and efficient implementations for distance metric learning
Proceedings of the 25th international conference on Machine learning
Letters: Adaptive local hyperplane classification
Neurocomputing
Learning a Mahalanobis distance metric for data clustering and classification
Pattern Recognition
Combining Weighted SVMs and Spectrum-Based kNN for Multi-classification
ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Advances in Neural Networks, Part III
IKNN: Informative K-Nearest Neighbor Pattern Classification
PKDD 2007 Proceedings of the 11th European conference on Principles and Practice of Knowledge Discovery in Databases
ECML PKDD '08 Proceedings of the 2008 European Conference on Machine Learning and Knowledge Discovery in Databases - Part I
Learning to hash: forgiving hash functions and applications
Data Mining and Knowledge Discovery
Pseudo nearest neighbor rule for pattern classification
Expert Systems with Applications: An International Journal
Local Metric Learning on Manifolds with Application to Query---Based Operations
SSPR & SPR '08 Proceedings of the 2008 Joint IAPR International Workshop on Structural, Syntactic, and Statistical Pattern Recognition
Learning Pairwise Dissimilarity Profiles for Appearance Recognition in Visual Surveillance
ISVC '08 Proceedings of the 4th International Symposium on Advances in Visual Computing
Computational Statistics & Data Analysis
Weighted locally linear embedding for dimension reduction
Pattern Recognition
Cluster-based nearest-neighbour classifier and its application on the lightning classification
Journal of Computer Science and Technology
Boosting k-nearest neighbor classifier by means of input space projection
Expert Systems with Applications: An International Journal
A method of learning weighted similarity function to improve the performance of nearest neighbor
Information Sciences: an International Journal
Optimizing similarity assessment in case-based reasoning
AAAI'06 proceedings of the 21st national conference on Artificial intelligence - Volume 2
An efficient algorithm for local distance metric learning
AAAI'06 Proceedings of the 21st national conference on Artificial intelligence - Volume 1
Metric learning for synonym acquisition
COLING '08 Proceedings of the 22nd International Conference on Computational Linguistics - Volume 1
Ensemble Learning: A Study on Different Variants of the Dynamic Selection Approach
MLDM '09 Proceedings of the 6th International Conference on Machine Learning and Data Mining in Pattern Recognition
Learning "forgiving" hash functions: algorithms and large scale tests
IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Stepwise nearest neighbor discriminant analysis
IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence
Inferring image templates from classification decisions
IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence
On optimum choice of k in nearest neighbor classification
Computational Statistics & Data Analysis
Sequential non-stationary dynamic classification with sparse feedback
Pattern Recognition
Semi-supervised metric learning using pairwise constraints
IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
HMM Approach for Classifying Protein Structures
FGIT '09 Proceedings of the 1st International Conference on Future Generation Information Technology
Kernel Difference-Weighted k-Nearest Neighbors Classification
ICIC '07 Proceedings of the 3rd International Conference on Intelligent Computing: Advanced Intelligent Computing Theories and Applications. With Aspects of Artificial Intelligence
Hierarchical Multi-view Fisher Discriminant Analysis
ICONIP '09 Proceedings of the 16th International Conference on Neural Information Processing: Part II
Application of combined support vector machines in process fault diagnosis
ACC'09 Proceedings of the 2009 conference on American Control Conference
Using clustering to learn distance functions for supervised similarity assessment
Engineering Applications of Artificial Intelligence
Kernel-based metric learning for semi-supervised clustering
Neurocomputing
A new dynamic ensemble selection method for numeral recognition
MCS'07 Proceedings of the 7th international conference on Multiple classifier systems
An efficient nearest neighbor classifier using an adaptive distance measure
CAIP'07 Proceedings of the 12th international conference on Computer analysis of images and patterns
Generalized iterative RELIEF for supervised distance metric learning
Pattern Recognition
Novel support vector clustering with label assignment in enriched neighborhood
FSKD'09 Proceedings of the 6th international conference on Fuzzy systems and knowledge discovery - Volume 1
Integrating induction and deduction for noisy data mining
Information Sciences: an International Journal
Transfer metric learning by learning task relationships
Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining
Soft Nearest Convex Hull Classifier
Proceedings of the 2010 conference on ECAI 2010: 19th European Conference on Artificial Intelligence
Nearest hit-misses component analysis for supervised metric learning
ICONIP'10 Proceedings of the 17th international conference on Neural information processing: theory and algorithms - Volume Part I
A centroid k-nearest neighbor method
ADMA'10 Proceedings of the 6th international conference on Advanced data mining and applications: Part I
Multi-class leveraged k-NN for image classification
ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part III
Review: data mining: Past, present and future
The Knowledge Engineering Review
Learning low-rank kernel matrices for constrained clustering
Neurocomputing
Spherical nearest neighbor classification: application to hyperspectral data
MLDM'11 Proceedings of the 7th international conference on Machine learning and data mining in pattern recognition
Pattern classification using a set of compact hyperspheres
ICONIP'06 Proceedings of the 13th international conference on Neural Information Processing - Volume Part II
Improving nearest neighbor rule with a simple adaptive distance measure
ICNC'06 Proceedings of the Second international conference on Advances in Natural Computation - Volume Part I
Adaptive nearest neighbor classifier based on supervised ellipsoid clustering
FSKD'06 Proceedings of the Third international conference on Fuzzy Systems and Knowledge Discovery
Functional classification with margin conditions
COLT'06 Proceedings of the 19th annual conference on Learning Theory
A novel two-level nearest neighbor classification algorithm using an adaptive distance metric
Knowledge-Based Systems
An affinity-based new local distance function and similarity measure for kNN algorithm
Pattern Recognition Letters
Feature-Weighted CBR with neural network for symbolic features
ICIC'06 Proceedings of the 2006 international conference on Intelligent Computing - Volume Part I
A statistical confidence-based adaptive nearest neighbor algorithm for pattern classification
ICMLC'05 Proceedings of the 4th international conference on Advances in Machine Learning and Cybernetics
Kernel-Based metric adaptation with pairwise constraints
ICMLC'05 Proceedings of the 4th international conference on Advances in Machine Learning and Cybernetics
Cluster-based adaptive metric classification
Neurocomputing
Hybrid system of case-based reasoning and neural network for symbolic features
DaWaK'05 Proceedings of the 7th international conference on Data Warehousing and Knowledge Discovery
Nearest neighbor classification using cam weighted distance
FSKD'05 Proceedings of the Second international conference on Fuzzy Systems and Knowledge Discovery - Volume Part II
ICNC'05 Proceedings of the First international conference on Advances in Natural Computation - Volume Part I
Using clustering to learn distance functions for supervised similarity assessment
MLDM'05 Proceedings of the 4th international conference on Machine Learning and Data Mining in Pattern Recognition
A new multidimensional feature transformation for linear classifiers and its applications
MLDM'05 Proceedings of the 4th international conference on Machine Learning and Data Mining in Pattern Recognition
On hybrid classification using model assisted posterior estimates
Pattern Recognition
Fast neighborhood component analysis
Neurocomputing
DBCAMM: A novel density based clustering algorithm via using the Mahalanobis metric
Applied Soft Computing
Analogy-based reasoning in classifier construction
Transactions on Rough Sets IV
Transfer Metric Learning with Semi-Supervised Extension
ACM Transactions on Intelligent Systems and Technology (TIST)
A novel nearest neighbor classifier based on adaptive nonparametric separability
AI'06 Proceedings of the 19th Australian joint conference on Artificial Intelligence: advances in Artificial Intelligence
BoostML: an adaptive metric learning for nearest neighbor classification
PAKDD'10 Proceedings of the 14th Pacific-Asia conference on Advances in Knowledge Discovery and Data Mining - Volume Part I
Efficient model selection for large-scale nearest-neighbor data mining
BNCOD'10 Proceedings of the 27th British national conference on Data Security and Security Data
Metric and kernel learning using a linear transformation
The Journal of Machine Learning Research
Journal of Mathematical Imaging and Vision
A probabilistic approach for semi-supervised nearest neighbor classification
Pattern Recognition Letters
Role and Results of statistical methods in protein fold class prediction
Mathematical and Computer Modelling: An International Journal
Pattern field classification with style normalized transformation
IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Two
A boosting approach for supervised Mahalanobis distance metric learning
Pattern Recognition
Feature weighting by RELIEF based on local hyperplane approximation
PAKDD'12 Proceedings of the 16th Pacific-Asia conference on Advances in Knowledge Discovery and Data Mining - Volume Part II
Positive semidefinite metric learning using boosting-like algorithms
The Journal of Machine Learning Research
Feature Extraction for Dynamic Integration of Classifiers
Fundamenta Informaticae
Review: Supervised classification and mathematical optimization
Computers and Operations Research
Ensemble approaches for regression: A survey
ACM Computing Surveys (CSUR)
Time series classification by class-specific Mahalanobis distance measures
Advances in Data Analysis and Classification
Boosting k-NN for Categorization of Natural Scenes
International Journal of Computer Vision
k nearest neighbor using ensemble clustering
DaWaK'12 Proceedings of the 14th international conference on Data Warehousing and Knowledge Discovery
Image annotation using metric learning in semantic neighbourhoods
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part III
Measuring image distances via embedding in a semantic manifold
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part IV
Mirror descent for metric learning: a unified approach
ECML PKDD'12 Proceedings of the 2012 European conference on Machine Learning and Knowledge Discovery in Databases - Volume Part I
Adaptive distance metrics for nearest neighbour classification based on genetic programming
EuroGP'13 Proceedings of the 16th European conference on Genetic Programming
Towards the Optimal Discriminant Subspace
WI-IAT '12 Proceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 01
Local discriminative distance metrics ensemble learning
Pattern Recognition
Class imbalance and the curse of minority hubs
Knowledge-Based Systems
Linear reconstruction measure steered nearest neighbor classification framework
Pattern Recognition
Fuzzy nearest neighbor algorithms: Taxonomy, experimental analysis and prospects
Information Sciences: an International Journal
An ensemble-clustering-based distance metric and its applications
International Journal of Business Intelligence and Data Mining
Benchmarking local classification methods
Computational Statistics
Fast classification for large data sets via random selection clustering and Support Vector Machines
Intelligent Data Analysis
| Hi-index | 0.15 |
Nearest neighbor classification expects the class conditional probabilities to be locally constant, and suffers from bias in high dimensions. We propose a locally adaptive form of nearest neighbor classification to try to ameliorate this curse of dimensionality. We use a local linear discriminant analysis to estimate an effective metric for computing neighborhoods. We determine the local decision boundaries from centroid information, and then shrink neighborhoods in directions orthogonal to these local decision boundaries, and elongate them parallel to the boundaries. Thereafter, any neighborhood-based classifier can be employed, using the modified neighborhoods. The posterior probabilities tend to be more homogeneous in the modified neighborhoods. We also propose a method for global dimension reduction, that combines local dimension information. In a number of examples, the methods demonstrate the potential for substantial improvements over nearest neighbor classification.