Using web structure for classifying and describing web pages
Proceedings of the 11th international conference on World Wide Web
On learning to predict web traffic
Decision Support Systems - Special issue: Web data mining
An intelligent system for customer targeting: a data mining approach
Decision Support Systems
Efficient Genetic Algorithm Based Data Mining Using Feature Selection with Hausdorff Distance
Information Technology and Management
Feature Selection for Reduction of Tabular Knowledge-Based Systems
Information Technology and Management
On preprocessing data for financial credit risk evaluation
Expert Systems with Applications: An International Journal
Correcting the Kullback-Leibler distance for feature selection
Pattern Recognition Letters
Time space tradeoffs in GA based feature selection for workload characterization
IEA/AIE'10 Proceedings of the 23rd international conference on Industrial engineering and other applications of applied intelligent systems - Volume Part II
| Hi-index | 0.00 |
A basic problem of information processing is selecting enough features to ensure that events are accurately represented for classification problems, while simultaneously minimizing storage and processing of irrelevant or marginally important features. To address this problem, feature selection procedures perform a search through the feature power set to find the smallest subset meeting performance requirements. Major restrictions of existing procedures are that they typically explicitly or implicitly assume a fixed operating point, and make limited use of the statistical structure of the feature power set. We present a method that combines the Neyman-Pearson design procedure on finite data, with the directed set structure of the Receiver Operating Curves on the feature sub-sets, to determine the maximal size of the feature subsets that can be ranked in a given problem. The search can then be restricted to the smaller subsets, resulting in significant reductions in computational complexity. Optimizing the overall Receiver Operating Curve also allows for end users to select different operating points and cost functions to optimize. The algorithm also produces a natural method of Boolean representation of the minimal feature combinations that best describe the data near a given operating point. These representations are especially appropriate when describing data using common text-related features useful on the web, such as thresholded TFIDF data. We show how to use these results to perform automatic Boolean query modification generation for distributed databases, such as niche metasearch engines.