Feature weighting by RELIEF based on local hyperplane approximation

Authors:
Hongmin Cai;Michael Ng
Affiliations:
South China University of Technology, Guangdong, P.R. China;Department of Mathematics, Hong Kong Baptist University, Hong Kong
Venue:
PAKDD'12 Proceedings of the 16th Pacific-Asia conference on Advances in Knowledge Discovery and Data Mining - Volume Part II
Year:
2012

Citing 21
Cited 0

Estimating attributes: analysis and extensions of RELIEF

ECML-94 Proceedings of the European conference on machine learning on Machine Learning
Discriminant Adaptive Nearest Neighbor Classification

IEEE Transactions on Pattern Analysis and Machine Intelligence
Locally Weighted Learning

Artificial Intelligence Review - Special issue on lazy learning
Text Categorization Based on Regularized Linear Classification Methods

Information Retrieval
Gene Selection for Cancer Classification using Support Vector Machines

Machine Learning
Feature Selection via Discretization

IEEE Transactions on Knowledge and Data Engineering
Locally Adaptive Metric Nearest-Neighbor Classification

IEEE Transactions on Pattern Analysis and Machine Intelligence
Input Feature Selection by Mutual Information Based on Parzen Window

IEEE Transactions on Pattern Analysis and Machine Intelligence
An introduction to variable and feature selection

The Journal of Machine Learning Research
Pattern Classification (2nd Edition)

Pattern Classification (2nd Edition)
Margin based feature selection - theory and algorithms

ICML '04 Proceedings of the twenty-first international conference on Machine learning
Sequence features of DNA binding sites reveal structural class of associated transcription factor

Bioinformatics
Nearest-Neighbor Methods in Learning and Vision: Theory and Practice (Neural Information Processing)

Nearest-Neighbor Methods in Learning and Vision: Theory and Practice (Neural Information Processing)
Iterative RELIEF for Feature Weighting: Algorithms, Theories, and Applications

IEEE Transactions on Pattern Analysis and Machine Intelligence
Application of wrapper approach and composite classifier to the stock trend prediction

Expert Systems with Applications: An International Journal
Letters: Adaptive local hyperplane classification

Neurocomputing
An Information Theoretic Perspective on Multiple Classifier Systems

MCS '09 Proceedings of the 8th International Workshop on Multiple Classifier Systems
A novel ensemble machine learning for robust microarray data classification

Computers in Biology and Medicine
Local-Learning-Based Feature Selection for High-Dimensional Data Analysis

IEEE Transactions on Pattern Analysis and Machine Intelligence
Some thoughts at the interface of ensemble methods and feature selection

MCS'10 Proceedings of the 9th international conference on Multiple Classifier Systems
Probability density estimation from optimally condensed data samples

IEEE Transactions on Pattern Analysis and Machine Intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we propose a new feature weighting algorithm through the classical RELIEF framework. The key idea is to estimate the feature weights through local approximation rather than global measurement, as used in previous methods. The weights obtained by our method are more robust to degradation of noisy features, even when the number of dimensions is huge. To demonstrate the performance of our method, we conduct experiments on classification by combining hyperplane KNN model (HKNN) and the proposed feature weight scheme. Empirical study on both synthetic and real-world data sets demonstrate the superior performance of the feature selection for supervised learning, and the effectiveness of our algorithm.