A critical investigation of recall and precision as measures of retrieval system performance
ACM Transactions on Information Systems (TOIS)
Introduction to algorithms
Foundations of statistical natural language processing
Foundations of statistical natural language processing
Explicitly representing expected cost: an alternative to ROC representation
Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining
Learning Decision Trees Using the Area Under the ROC Curve
ICML '02 Proceedings of the Nineteenth International Conference on Machine Learning
The Case against Accuracy Estimation for Comparing Induction Algorithms
ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning
An Efficient Boosting Algorithm for Combining Preferences
ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning
Optimising area under the ROC curve using gradient descent
ICML '04 Proceedings of the twenty-first international conference on Machine learning
A support vector method for multivariate performance measures
ICML '05 Proceedings of the 22nd international conference on Machine learning
Learning the structure of Markov logic networks
ICML '05 Proceedings of the 22nd international conference on Machine learning
Learning ensembles of first-order clauses that optimize precision-recall curves
Learning ensembles of first-order clauses that optimize precision-recall curves
Discriminative training of Markov logic networks
AAAI'05 Proceedings of the 20th national conference on Artificial intelligence - Volume 2
View learning for statistical relational learning: with an application to mammography
IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence
ROCCER: an algorithm for rule learning based on ROC analysis
IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence
Comparative experiments on learning information extractors for proteins and their interactions
Artificial Intelligence in Medicine
A support vector method for optimizing average precision
SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
Evaluation of recommender systems: A new approach
Expert Systems with Applications: An International Journal
Discriminative structure and parameter learning for Markov logic networks
Proceedings of the 25th international conference on Machine learning
A multifactor approach to student model evaluation
User Modeling and User-Adapted Interaction
Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining
Techniques for evaluating fault prediction models
Empirical Software Engineering
Decision trees for hierarchical multi-label classification
Machine Learning
Discriminative Structure Learning of Markov Logic Networks
ILP '08 Proceedings of the 18th international conference on Inductive Logic Programming
Using Cost-Sensitive Learning to Determine Gene Conversions
ICIC '08 Proceedings of the 4th international conference on Intelligent Computing: Advanced Intelligent Computing Theories and Applications - with Aspects of Artificial Intelligence
Evaluation and Comparison of Inferred Regular Grammars
ICGI '08 Proceedings of the 9th international colloquium on Grammatical Inference: Algorithms and Applications
The role of syntactic features in protein interaction extraction
Proceedings of the 2nd international workshop on Data and text mining in bioinformatics
An experimental comparison of performance measures for classification
Pattern Recognition Letters
Extracting Concept Hierarchy Knowledge from the Web Based on Property Inheritance and Aggregation
WI-IAT '08 Proceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology - Volume 01
Handling class imbalance in customer churn prediction
Expert Systems with Applications: An International Journal
Nonparametric estimation of the precision-recall curve
ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Towards design principles for effective context- and perspective-based web mining
Proceedings of the 4th International Conference on Design Science Research in Information Systems and Technology
Set Cover Feature Selection for Text Categorisation and spam detection
International Journal of Advanced Intelligence Paradigms
A method for detecting the theft of Java programs through analysis of the control flow information
Information and Software Technology
Structure Learning of Markov Logic Networks through Iterated Local Search
Proceedings of the 2008 conference on ECAI 2008: 18th European Conference on Artificial Intelligence
Matrix Metric Adaptation Linear Discriminant Analysis of Biomedical Data
IWANN '09 Proceedings of the 10th International Work-Conference on Artificial Neural Networks: Part I: Bio-Inspired Systems: Computational and Ambient Intelligence
A Mutual Information Approach to Data Integration for Alzheimer's Disease Patients
AIME '09 Proceedings of the 12th Conference on Artificial Intelligence in Medicine: Artificial Intelligence in Medicine
Hidden dynamic probabilistic models for labeling sequence data
AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 2
May all your wishes come true: a study of wishes and how to recognize them
NAACL '09 Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics
Real Time Foreground-Background Segmentation Using a Modified Codebook Model
AVSS '09 Proceedings of the 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance
Low-complexity iris coding and recognition based on directionlets
IEEE Transactions on Information Forensics and Security
A pattern similarity scheme for medical image retrieval
IEEE Transactions on Information Technology in Biomedicine - Special section on biomedical informatics
On strategies for imbalanced text classification using SVM: A comparative study
Decision Support Systems
Episode-constrained cross-validation in video concept retrieval
IEEE Transactions on Multimedia
A comprehensive evaluation framework and a comparative study for human detectors
IEEE Transactions on Intelligent Transportation Systems
SVMs modeling for highly imbalanced classification
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics - Special issue on human computing
An empirical comparison of repetitive undersampling techniques
IRI'09 Proceedings of the 10th IEEE international conference on Information Reuse & Integration
Aggregating performance metrics for classifier evaluation
IRI'09 Proceedings of the 10th IEEE international conference on Information Reuse & Integration
Precision and Recall for Regression
DS '09 Proceedings of the 12th International Conference on Discovery Science
Efficient Peak-Labeling Algorithms for Whole-Sample Mass Spectrometry Proteomics
IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Cost curve analysis of biometric system performance
BTAS'09 Proceedings of the 3rd IEEE international conference on Biometrics: Theory, applications and systems
Computers in Biology and Medicine
Blended metrics for novel sentence mining
Expert Systems with Applications: An International Journal
Reconstructing the topology of protein complexes
RECOMB'07 Proceedings of the 11th annual international conference on Research in computational molecular biology
A large-scale active learning system for topical categorization on the web
Proceedings of the 19th international conference on World wide web
Revisiting the evaluation of segmentation results: introducing confidence maps
MICCAI'07 Proceedings of the 10th international conference on Medical image computing and computer-assisted intervention
Cost-sensitive classifier evaluation using cost curves
PAKDD'08 Proceedings of the 12th Pacific-Asia conference on Advances in knowledge discovery and data mining
Tabu annealing: an efficient and scalable strategy for document retrieval
International Journal of Intelligent Information and Database Systems
Trust network inference for online rating data using generative models
Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining
IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Detecting object boundaries using low-, mid-, and high-level information
Computer Vision and Image Understanding
Pattern Recognition Letters
ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
Simple time-biased KNN-based recommendations
Proceedings of the Workshop on Context-Aware Movie Recommendation
Movie recommendations based in explicit and implicit features extracted from the Filmtipset dataset
Proceedings of the Workshop on Context-Aware Movie Recommendation
Adaptive methods for classification in arbitrarily imbalanced and drifting data streams
PAKDD'09 Proceedings of the 13th Pacific-Asia international conference on Knowledge discovery and data mining: new frontiers in applied data mining
Hub gene selection methods for the reconstruction of transcription networks
ECML PKDD'10 Proceedings of the 2010 European conference on Machine learning and knowledge discovery in databases: Part I
A comparison of machine learning techniques for detection of drug target articles
Journal of Biomedical Informatics
Boosting first-order clauses for large, skewed data sets
ILP'09 Proceedings of the 19th international conference on Inductive logic programming
Learning without default: a study of one-class classification and the low-default portfolio problem
AICS'09 Proceedings of the 20th Irish conference on Artificial intelligence and cognitive science
Generative Structure Learning for Markov Logic Networks
Proceedings of the 2010 conference on STAIRS 2010: Proceedings of the Fifth Starting AI Researchers' Symposium
Journal on Image and Video Processing - Special issue on advanced video-based surveillance
S.cerevisiae complex function prediction with modular multi-relational framework
IEA/AIE'10 Proceedings of the 23rd international conference on Industrial engineering and other applications of applied intelligent systems - Volume Part III
Discriminative Markov logic network structure learning based on propositionalization and X2-test
ADMA'10 Proceedings of the 6th international conference on Advanced data mining and applications: Part I
Wikipedia vandalism detection: combining natural language, metadata, and reputation features
CICLing'11 Proceedings of the 12th international conference on Computational linguistics and intelligent text processing - Volume Part II
Boosting learning and inference in Markov logic through metaheuristics
Applied Intelligence
An empirical comparison of static and dynamic business process mining
Proceedings of the 2011 ACM Symposium on Applied Computing
Diagnosis of cardiac arrhythmia using fuzzy immune approach
ICANNGA'11 Proceedings of the 10th international conference on Adaptive and natural computing algorithms - Volume Part II
Categorization of display ads using image and landing page features
Proceedings of the Third Workshop on Large Scale Data Mining: Theory and Applications
Balance support vector machines locally using the structural similarity kernel
PAKDD'11 Proceedings of the 15th Pacific-Asia conference on Advances in knowledge discovery and data mining - Volume Part I
Class confidence weighted kNN algorithms for imbalanced data sets
PAKDD'11 Proceedings of the 15th Pacific-Asia conference on Advances in knowledge discovery and data mining - Volume Part II
Hierarchical multilabel protein function prediction using local neural networks
BSB'11 Proceedings of the 6th Brazilian conference on Advances in bioinformatics and computational biology
KES'11 Proceedings of the 15th international conference on Knowledge-based and intelligent information and engineering systems - Volume Part I
A learning strategy for highly imbalanced classification
Proceedings of the Third International Conference on Internet Multimedia Computing and Service
An efficient approximation to lookahead in relational learners
ECML'06 Proceedings of the 17th European conference on Machine Learning
Predicting high-risk program modules by selecting the right software measurements
Software Quality Control
Bayesian credibility modeling for personalized recommendation in participatory media
UMAP'10 Proceedings of the 18th international conference on User Modeling, Adaptation, and Personalization
Image-Based grasping point detection using boosted histograms of oriented gradients
ICIAR'10 Proceedings of the 7th international conference on Image Analysis and Recognition - Volume Part I
Multivariate statistical tests for comparing classification algorithms
LION'05 Proceedings of the 5th international conference on Learning and Intelligent Optimization
Mixing hierarchical contexts for object recognition
CIARP'11 Proceedings of the 16th Iberoamerican Congress conference on Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications
Factorizing YAGO: scalable machine learning for linked data
Proceedings of the 21st international conference on World Wide Web
Vertex collocation profiles: subgraph counting for link analysis and prediction
Proceedings of the 21st international conference on World Wide Web
A case study on meta-generalising: a Gaussian processes approach
The Journal of Machine Learning Research
Mutual Information Optimization for Mass Spectra Data Alignment
IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Decision support for the software product line domain engineering lifecycle
Automated Software Engineering
A Survey on Filter Techniques for Feature Selection in Gene Expression Microarray Analysis
IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Shape based appearance model for kernel tracking
Image and Vision Computing
Towards automatic polyp detection with a polyp appearance model
Pattern Recognition
A genetic algorithm for Hierarchical Multi-Label Classification
Proceedings of the 27th Annual ACM Symposium on Applied Computing
Generative structure learning for Markov logic networks based on graph of predicates
IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Two
Imitation learning in relational domains: a functional-gradient boosting approach
IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Two
Using a shallow linguistic kernel for drug-drug interaction extraction
Journal of Biomedical Informatics
A case study on business process recovery using an e-government system
Software—Practice & Experience
TFMAP: optimizing MAP for top-n context-aware recommendation
SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
Hybrid Matching Algorithm for Personal Names
Journal of Data and Information Quality (JDIQ)
Globalized bipartite local model for drug-target interaction prediction
Proceedings of the 11th International Workshop on Data Mining in Bioinformatics
WTF? detecting students who are conducting inquiry without thinking fastidiously
UMAP'12 Proceedings of the 20th international conference on User Modeling, Adaptation, and Personalization
Learning the structure of probabilistic logic programs
ILP'11 Proceedings of the 21st international conference on Inductive Logic Programming
Fitness function based on binding and recall rate for genetic inductive logic programming
ICSI'12 Proceedings of the Third international conference on Advances in Swarm Intelligence - Volume Part I
Relation mining experiments in the pharmacogenomics domain
Journal of Biomedical Informatics
Exploiting latent information to predict diffusions of novel topics on social networks
ACL '12 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Short Papers - Volume 2
Trust prediction via aggregating heterogeneous social networks
Proceedings of the 21st ACM international conference on Information and knowledge management
MICCAI'12 Proceedings of the 15th international conference on Medical Image Computing and Computer-Assisted Intervention - Volume Part I
Relational differential prediction
ECML PKDD'12 Proceedings of the 2012 European conference on Machine Learning and Knowledge Discovery in Databases - Volume Part I
Visual saliency detection with center shift
Neurocomputing
Design and Analysis of Classifier Learning Experiments in Bioinformatics: Survey and Case Studies
IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Threshold optimisation for multi-label classifiers
Pattern Recognition
A new evaluation measure for imbalanced datasets
AusDM '08 Proceedings of the 7th Australasian Data Mining Conference - Volume 87
Link Prediction for Bipartite Social Networks: The Role of Structural Holes
ASONAM '12 Proceedings of the 2012 International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2012)
Link Prediction: Fair and Effective Evaluation
ASONAM '12 Proceedings of the 2012 International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2012)
Robust fall detection by combining 3d data and fuzzy logic
ACCV'12 Proceedings of the 11th international conference on Computer Vision - Volume 2
Efficacious end user measures part 1: relative class size and end user problem domains
Advances in Artificial Intelligence - Special issue on Artificial Intelligence Applications in Biomedicine
Unsupervised link prediction using aggregative statistics on heterogeneous social networks
Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining
Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining
Predictive model performance: offline and online evaluations
Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining
Amplifying the voice of youth in Africa via text analytics
Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining
A possibilistic approach to intrusion detection under imperfect logging protocol
Proceedings of the 6th International Conference on Security of Information and Networks
Parameter learning for probabilistic ontologies
RR'13 Proceedings of the 7th international conference on Web Reasoning and Rule Systems
Hierarchical multi-label classification using local neural networks
Journal of Computer and System Sciences
Information quality measurement of medical encoding support based on usability
Computer Methods and Programs in Biomedicine
Social trust prediction using heterogeneous networks
ACM Transactions on Knowledge Discovery from Data (TKDD)
Amplitude-only log Radon transform for geometric invariant shape descriptor
Pattern Recognition
An in-depth study of the potentially confounding effect of class size in fault prediction
ACM Transactions on Software Engineering and Methodology (TOSEM)
Training and assessing classification rules with imbalanced data
Data Mining and Knowledge Discovery
ReliAble dependency arc recognition
Expert Systems with Applications: An International Journal
Proceedings of the Fourth International Conference on Learning Analytics And Knowledge
Detecting rare events using extreme value statistics applied to epileptic convulsions in children
Artificial Intelligence in Medicine
On 3D object retrieval benchmarking
3D Research
Expectation maximization over binary decision diagrams for probabilistic logic programs
Intelligent Data Analysis
ROC analysis of classifiers in machine learning: A survey
Intelligent Data Analysis
Hi-index | 0.01 |
Receiver Operator Characteristic (ROC) curves are commonly used to present results for binary decision problems in machine learning. However, when dealing with highly skewed datasets, Precision-Recall (PR) curves give a more informative picture of an algorithm's performance. We show that a deep connection exists between ROC space and PR space, such that a curve dominates in ROC space if and only if it dominates in PR space. A corollary is the notion of an achievable PR curve, which has properties much like the convex hull in ROC space; we show an efficient algorithm for computing this curve. Finally, we also note differences in the two types of curves are significant for algorithm design. For example, in PR space it is incorrect to linearly interpolate between points. Furthermore, algorithms that optimize the area under the ROC curve are not guaranteed to optimize the area under the PR curve.