Machine Learning for the Detection of Oil Spills in Satellite Radar Images

Authors:
Miroslav Kubat;Robert C. Holte;Stan Matwin
Affiliations:
School of Information Technology and Engineering, University of Ottawa, 150 Louis Pasteur, Ottawa Ontario, K1N 6N5 Canada.;School of Information Technology and Engineering, University of Ottawa, 150 Louis Pasteur, Ottawa Ontario, K1N 6N5 Canada.;School of Information Technology and Engineering, University of Ottawa, 150 Louis Pasteur, Ottawa Ontario, K1N 6N5 Canada.
Venue:
Machine Learning - Special issue on applications of machine learning and the knowledge discovery process
Year:
1998

Citing 23
Cited 144

Structured induction in expert systems

Structured induction in expert systems
Instance-Based Learning Algorithms

Machine Learning
Information-Based Evaluation Criterion for Classifier's Performance

Machine Learning
Generalizing from case studies: a case study

ML92 Proceedings of the ninth international workshop on Machine learning
Selecting typical instances in instance-based learning

ML92 Proceedings of the ninth international workshop on Machine learning
C4.5: programs for machine learning

C4.5: programs for machine learning
A sequential algorithm for training text classifiers

SIGIR '94 Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval
Selecting salient features for machine learning from large candidate pools through parallel decision-tree construction

Massively parallel artificial intelligence
Bivariate splits and consistent split criteria in dichotomous classification trees

Bivariate splits and consistent split criteria in dichotomous classification trees
Searching for Representations to Improve Protein Sequence Fold-Class Prediction

Machine Learning - Special issue on applications in molecular biology
Inductive Policy: The Pragmatics of Bias Selection

Machine Learning - Special issue on bias evaluation and selection
A Comparison of ID3 and Backpropagation for English Text-To-Speech Mapping

Machine Learning
Applications of machine learning and rule induction

Communications of the ACM
Sample Compression, Learnability, and the Vapnik-Chervonenkis Dimension

Machine Learning
Learning in the presence of concept drift and hidden contexts

Machine Learning
Solving the multiple instance problem with axis-parallel rectangles

Artificial Intelligence
Wrappers for feature subset selection

Artificial Intelligence - Special issue on relevance
Learning to Recognize Volcanoes on Venus

Machine Learning - Special issue on applications of machine learning and the knowledge discovery process
Knowledge-Based Learning in Exploratory Science: Learning Rules to Predict Rodent Carcinogenicity

Machine Learning - Special issue on applications of machine learning and the knowledge discovery process
Information Retrieval

Information Retrieval
Adaptive Fraud Detection

Data Mining and Knowledge Discovery
Exploiting Context When Learning to Classify

ECML '93 Proceedings of the European Conference on Machine Learning
Learning When Negative Examples Abound

ECML '97 Proceedings of the 9th European Conference on Machine Learning

Guest Editors‘ Introduction: On Applied Research in MachineLearning

Machine Learning - Special issue on applications of machine learning and the knowledge discovery process
Learning to Recognize Volcanoes on Venus

Machine Learning - Special issue on applications of machine learning and the knowledge discovery process
Explicitly representing expected cost: an alternative to ROC representation

Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining
Robust Classification for Imprecise Environments

Machine Learning
Parametric Algorithms for Mining Share Frequent Itemsets

Journal of Intelligent Information Systems
Learning Algorithms for Keyphrase Extraction

Information Retrieval
Supervised Versus Unsupervised Binary-Learning by Feedforward Neural Networks

Machine Learning
Evaluating Training Data Suitability for Decision Tree Induction

Journal of Medical Systems
Data Mining to Predict Aircraft Component Replacement

IEEE Intelligent Systems
Parametric Algorithms for Mining Share-Frequent Itemsets

ISMIS '00 Proceedings of the 12th International Symposium on Foundations of Intelligent Systems
A Case Study for Learning from Imbalanced Data Sets

AI '01 Proceedings of the 14th Biennial Conference of the Canadian Society on Computational Studies of Intelligence: Advances in Artificial Intelligence
A Recognition-Based Alternative to Discrimination-Based Multi-layer Perceptrons

AI '00 Proceedings of the 13th Biennial Conference of the Canadian Society on Computational Studies of Intelligence: Advances in Artificial Intelligence
Sciences: environmental sciences

Handbook of data mining and knowledge discovery
Complexity in the case against accuracy estimation

Theoretical Computer Science
Improved Rooftop Detection in Aerial Images with Machine Learning

Machine Learning
Bootstrapping Rule Induction

ICDM '03 Proceedings of the Third IEEE International Conference on Data Mining
Mining with rarity: a unifying framework

ACM SIGKDD Explorations Newsletter - Special issue on learning from imbalanced datasets
Learning from imbalanced data sets with boosting and data generation: the DataBoost-IM approach

ACM SIGKDD Explorations Newsletter - Special issue on learning from imbalanced datasets
Class imbalances versus small disjuncts

ACM SIGKDD Explorations Newsletter - Special issue on learning from imbalanced datasets
Introduction: Lessons Learned from Data Mining Applications and Collaborative Problem Solving

Machine Learning
Classification and knowledge discovery in protein databases

Journal of Biomedical Informatics - Special issue: Biomedical machine learning
Applying both positive and negative selection to supervised learning for anomaly detection

GECCO '05 Proceedings of the 7th annual conference on Genetic and evolutionary computation
Learning to predict train wheel failures

Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining
Wrapper-based computation and evaluation of sampling methods for imbalanced datasets

UBDM '05 Proceedings of the 1st international workshop on Utility-based data mining
Bootstrapping rule induction to achieve rule stability and reduction

Journal of Intelligent Information Systems
An introduction to ROC analysis

Pattern Recognition Letters - Special issue: ROC analysis in pattern recognition
ROC curves and video analysis optimization in intestinal capsule endoscopy

Pattern Recognition Letters - Special issue: ROC analysis in pattern recognition
Cost curves: An improved method for visualizing classifier performance

Machine Learning
Computational Intelligence: Concepts to Implementations

Computational Intelligence: Concepts to Implementations
On the neural network classification of medical data and an endeavour to balance non-uniform data sets with artificial data extension

Computers in Biology and Medicine
Selective fusion of heterogeneous classifiers

Intelligent Data Analysis
Minimax Regret Classifier for Imprecise Class Distributions

The Journal of Machine Learning Research
Adequate and Precise Evaluation of Quality Models in Software Engineering Studies

PROMISE '07 Proceedings of the Third International Workshop on Predictor Models in Software Engineering
Local decomposition for rare class analysis

Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining
Cost-sensitive boosting for classification of imbalanced data

Pattern Recognition
The class imbalance problem: A systematic study

Intelligent Data Analysis
Instance-based data reduction for improved identification of difficult small classes

Intelligent Data Analysis
Learning on the border: active learning in imbalanced data classification

Proceedings of the sixteenth ACM conference on Conference on information and knowledge management
Flexible patient rule induction method for optimizing process variables in discrete type

Expert Systems with Applications: An International Journal
An approach to mining the multi-relational imbalanced database

Expert Systems with Applications: An International Journal
Floatcascade learning for fast imbalanced web mining

Proceedings of the 17th international conference on World Wide Web
Selective costing voting for bankruptcy prediction

International Journal of Knowledge-based and Intelligent Engineering Systems
Detection of stock price movements using chance discovery and genetic programming

International Journal of Knowledge-based and Intelligent Engineering Systems - Chance discovery
Classification of weld flaws with imbalanced class data

Expert Systems with Applications: An International Journal
A study of the behaviour of linguistic fuzzy rule based classification systems in the framework of imbalanced data-sets

Fuzzy Sets and Systems
GenSoFNN-Yager: A novel brain-inspired generic self-organizing neuro-fuzzy system realizing Yager inference

Expert Systems with Applications: An International Journal
Automatically countering imbalance and its empirical relationship to cost

Data Mining and Knowledge Discovery
Techniques for evaluating fault prediction models

Empirical Software Engineering
Using Intuitionistic Fuzzy Sets in Text Categorization

ICAISC '08 Proceedings of the 9th international conference on Artificial Intelligence and Soft Computing
FLSOM with Different Rates for Classification in Imbalanced Datasets

ICANN '08 Proceedings of the 18th international conference on Artificial Neural Networks, Part I
Learning Decision Trees for Unbalanced Data

ECML PKDD '08 Proceedings of the 2008 European Conference on Machine Learning and Knowledge Discovery in Databases - Part I
Dark formation detection using neural networks

International Journal of Remote Sensing
Local reweight wrapper for the problem of imbalance

International Journal of Artificial Intelligence and Soft Computing
Handling imbalanced data sets with a modification of Decorate algorithm

International Journal of Computer Applications in Technology
Learning from Skewed Class Multi-relational Databases

Fundamenta Informaticae - Progress on Multi-Relational Data Mining
Educational data mining: a case study for predicting dropout-prone students

International Journal of Knowledge Engineering and Soft Data Paradigms
Empirical analysis of support vector machine ensemble classifiers

Expert Systems with Applications: An International Journal
Web robot detection: A probabilistic reasoning approach

Computer Networks: The International Journal of Computer and Telecommunications Networking
On the use of surrounding neighbors for synthetic over-sampling of the minority class

SMO'08 Proceedings of the 8th conference on Simulation, modelling and optimization
Hierarchical fuzzy rule based classification systems with genetic rule selection for imbalanced data-sets

International Journal of Approximate Reasoning
On the influence of an adaptive inference system in fuzzy rule based classification systems for imbalanced data-sets

Expert Systems with Applications: An International Journal
Safe-Level-SMOTE: Safe-Level-Synthetic Minority Over-Sampling TEchnique for Handling the Class Imbalanced Problem

PAKDD '09 Proceedings of the 13th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining
Cost-Based Sampling of Individual Instances

Canadian AI '09 Proceedings of the 22nd Canadian Conference on Artificial Intelligence: Advances in Artificial Intelligence
Imbalanced Training Set Reduction and Feature Selection Through Genetic Optimization

Proceedings of the 2005 conference on Artificial Intelligence Research and Development
Enhancing the effectiveness and interpretability of decision tree and rule induction classifiers with evolutionary training set selection over imbalanced problems

Applied Soft Computing
Using Context to Identify Difficult Driving Situations in Unstructured Environments

FAC '09 Proceedings of the 5th International Conference on Foundations of Augmented Cognition. Neuroergonomics and Operational Neuroscience: Held as Part of HCI International 2009
Handling Class Imbalance Problems via Weighted BP Algorithm

ADMA '09 Proceedings of the 5th International Conference on Advanced Data Mining and Applications
SMOTE: synthetic minority over-sampling technique

Journal of Artificial Intelligence Research
Comparative experiments on learning information extractors for proteins and their interactions

Artificial Intelligence in Medicine
Bayesian network classifiers for mineral potential mapping

Computers & Geosciences
Aggregating performance metrics for classifier evaluation

IRI'09 Proceedings of the 10th IEEE international conference on Information Reuse & Integration
Classifying Multiple Imbalanced Attributes in Relational Data

AI '09 Proceedings of the 22nd Australasian Joint Conference on Advances in Artificial Intelligence
Support vector self-organizing learning for imbalanced medical data

IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Handling class imbalance problem in cultural modeling

ISI'09 Proceedings of the 2009 IEEE international conference on Intelligence and security informatics
Automatic identification of oil spills on satellite images

Environmental Modelling & Software
Selective costing ensemble for handling imbalanced data sets

International Journal of Hybrid Intelligent Systems
An investigation of neural network classifiers with unequal misclassification costs and group sizes

Decision Support Systems
COG: local decomposition for rare class analysis

Data Mining and Knowledge Discovery
Minimax classifiers based on neural networks

Pattern Recognition
A large-scale active learning system for topical categorization on the web

Proceedings of the 19th international conference on World wide web
An unbalanced data classification model using hybrid sampling technique for fraud detection

PReMI'07 Proceedings of the 2nd international conference on Pattern recognition and machine intelligence
Restoration of double-sided ancient music documents with bleed-through

CIARP'07 Proceedings of the Congress on pattern recognition 12th Iberoamerican conference on Progress in pattern recognition, image analysis and applications
Analyzing PETs on imbalanced datasets when training and testing class distributions differ

PAKDD'08 Proceedings of the 12th Pacific-Asia conference on Advances in knowledge discovery and data mining
An FIS for early detection of defect prone modules

ICIC'09 Proceedings of the Intelligent computing 5th international conference on Emerging intelligent computing technology and applications
An unsupervised self-organizing learning with support vector ranking for imbalanced datasets

Expert Systems with Applications: An International Journal
Robust weighted kernel logistic regression in imbalanced and rare events data

Computational Statistics & Data Analysis
Experienced physicians and automatic generation of decision rules from clinical data

RSCTC'10 Proceedings of the 7th international conference on Rough sets and current trends in computing
RAMOBoost: ranked minority oversampling in boosting

IEEE Transactions on Neural Networks
Learning classifiers from imbalanced data based on biased minimax probability machine

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Novel classification method for sensitive problems and uneven datasets based on neural networks and fuzzy logic

Applied Soft Computing
Class information adapted kernel for support vector machine

ICONIP'10 Proceedings of the 17th international conference on Neural information processing: models and applications - Volume Part II
Class imbalance methods for translation initiation site recognition

IEA/AIE'10 Proceedings of the 23rd international conference on Industrial engineering and other applications of applied intelligent systems - Volume Part I
Exploring the performance of resampling strategies for the class imbalance problem

IEA/AIE'10 Proceedings of the 23rd international conference on Industrial engineering and other applications of applied intelligent systems - Volume Part I
A dynamic over-sampling procedure based on sensitivity for multi-class problems

Pattern Recognition
Borderline over-sampling for imbalanced data classification

International Journal of Knowledge Engineering and Soft Data Paradigms
A hierarchical shrinking decision tree for imbalanced datasets

DNCOCO'06 Proceedings of the 5th WSEAS international conference on Data networks, communications and computers
An empirical analysis of under-sampling techniques to balance a protein structural class dataset

ICONIP'06 Proceedings of the 13th international conference on Neural information processing - Volume Part III
Combining integrated sampling with SVM ensembles for learning from imbalanced datasets

Information Processing and Management: an International Journal
A new frontier in novelty detection: pattern recognition of stochastically episodic events

ACIIDS'11 Proceedings of the Third international conference on Intelligent information and database systems - Volume Part I
Resampling methods versus cost functions for training an MLP in the class imbalance context

ISNN'11 Proceedings of the 8th international conference on Advances in neural networks - Volume Part II
Classifying severely imbalanced data

Canadian AI'11 Proceedings of the 24th Canadian conference on Advances in artificial intelligence
ClassySeg: a machine learning approach to automatic stroke segmentation

Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling
Classification of high dimensional and imbalanced hyperspectral imagery data

IbPRIA'11 Proceedings of the 5th Iberian conference on Pattern recognition and image analysis
Margin-based over-sampling method for learning from imbalanced datasets

PAKDD'11 Proceedings of the 15th Pacific-Asia conference on Advances in knowledge discovery and data mining - Volume Part II
Improving k nearest neighbor with exemplar generalization for imbalanced classification

PAKDD'11 Proceedings of the 15th Pacific-Asia conference on Advances in knowledge discovery and data mining - Volume Part II
On the effectiveness of preprocessing methods when dealing with different levels of class imbalance

Knowledge-Based Systems
Class imbalance methods for translation initiation site recognition in DNA sequences

Knowledge-Based Systems
Feature selection for translation initiation site recognition

IEA/AIE'11 Proceedings of the 24th international conference on Industrial engineering and other applications of applied intelligent systems conference on Modern approaches in applied intelligence - Volume Part II
Translation initiation site recognition by means of evolutionary response surfaces

IEA/AIE'11 Proceedings of the 24th international conference on Industrial engineering and other applications of applied intelligent systems conference on Modern approaches in applied intelligence - Volume Part II
An evolutionary algorithm for gene structure prediction

IEA/AIE'11 Proceedings of the 24th international conference on Industrial engineering and other applications of applied intelligent systems conference on Modern approaches in applied intelligence - Volume Part II
Exploring synergetic effects of dimensionality reduction and resampling tools on hyperspectral imagery data classification

MLDM'11 Proceedings of the 7th international conference on Machine learning and data mining in pattern recognition
A comparison of two strategies for scaling up instance selection in huge datasets

CAEPIA'11 Proceedings of the 14th international conference on Advances in artificial intelligence: spanish association for artificial intelligence
Instance selection for class imbalanced problems by means of selecting instances more than once

CAEPIA'11 Proceedings of the 14th international conference on Advances in artificial intelligence: spanish association for artificial intelligence
Boosting prediction accuracy on imbalanced datasets with SVM ensembles

PAKDD'06 Proceedings of the 10th Pacific-Asia conference on Advances in Knowledge Discovery and Data Mining
Many are better than one: improving probabilistic estimates from decision trees

MLCW'05 Proceedings of the First international conference on Machine Learning Challenges: evaluating Predictive Uncertainty Visual Object Classification, and Recognizing Textual Entailment
An imbalanced data rule learner

PKDD'05 Proceedings of the 9th European conference on Principles and Practice of Knowledge Discovery in Databases
Developing robust models for favourability analysis

WASSA '11 Proceedings of the 2nd Workshop on Computational Approaches to Subjectivity and Sentiment Analysis
Adjusting and generalizing CBA algorithm to handling class imbalance

Expert Systems with Applications: An International Journal
The class imbalance problem in TLC image classification

ICIAR'06 Proceedings of the Third international conference on Image Analysis and Recognition - Volume Part II
Parameter inference of cost-sensitive boosting algorithms

MLDM'05 Proceedings of the 4th international conference on Machine Learning and Data Mining in Pattern Recognition
Borderline-SMOTE: a new over-sampling method in imbalanced data sets learning

ICIC'05 Proceedings of the 2005 international conference on Advances in Intelligent Computing - Volume Part I
Improved response modeling based on clustering, under-sampling, and ensemble

Expert Systems with Applications: An International Journal
EUS SVMs: ensemble of under-sampled SVMs for data imbalance problems

ICONIP'06 Proceedings of the 13 international conference on Neural Information Processing - Volume Part I
The repository method for chance discovery in financial forecasting

KES'06 Proceedings of the 10th international conference on Knowledge-Based Intelligent Information and Engineering Systems - Volume Part III
Incremental learning of new classes in unbalanced datasets: Learn++.UDNC

MCS'10 Proceedings of the 9th international conference on Multiple Classifier Systems
A novel synthetic minority oversampling technique for imbalanced data set learning

ICONIP'11 Proceedings of the 18th international conference on Neural Information Processing - Volume Part II
Preprocessing unbalanced data using support vector machine

Decision Support Systems
A new over-sampling approach: Random-SMOTE for learning from imbalanced data sets

KSEM'11 Proceedings of the 5th international conference on Knowledge Science, Engineering and Management
An empirical evaluation of bagging with different algorithms on imbalanced data

ADMA'11 Proceedings of the 7th international conference on Advanced Data Mining and Applications - Volume Part I
Editorial: Large scale instance selection by means of federal instance selection

Data & Knowledge Engineering
Diagnosis of gastric carcinoma by classification on feature projections

Artificial Intelligence in Medicine
The problem of bias in training data in regression problems in medical decision support

Artificial Intelligence in Medicine
On developing robust models for favourability analysis: Model choice, feature sets and imbalanced data

Decision Support Systems
Learning from Skewed Class Multi-relational Databases

Fundamenta Informaticae - Progress on Multi-Relational Data Mining
Clustering based one-class classification for compliance verification of the comprehensive nuclear-test-ban treaty

Canadian AI'12 Proceedings of the 25th Canadian conference on Advances in Artificial Intelligence
Model fusion-based batch learning with application to oil spills detection

IEA/AIE'12 Proceedings of the 25th international conference on Industrial Engineering and Other Applications of Applied Intelligent Systems: advanced research in applied artificial intelligence
On the pattern recognition and classification of stochastically episodic events

Transactions on Compuational Collective Intelligence VI
A modified support vector data description based novelty detection approach for machinery components

Applied Soft Computing
An empirical study of learning from imbalanced data

ADC '11 Proceedings of the Twenty-Second Australasian Database Conference - Volume 115
Handling imbalanced data sets with synthetic boundary data generation using bootstrap re-sampling and AdaBoost techniques

Pattern Recognition Letters
Classification and outlier detection based on topic based pattern synthesis

MLDM'13 Proceedings of the 9th international conference on Machine Learning and Data Mining in Pattern Recognition
Technical Section: A machine learning approach to automatic stroke segmentation

Computers and Graphics
Weighted Online Sequential Extreme Learning Machine for Class Imbalance Learning

Neural Processing Letters
Enhanced and hierarchical structure algorithm for data imbalance problem in semantic extraction under massive video dataset

Multimedia Tools and Applications

Quantified Score

Hi-index	0.01

Visualization

Abstract

During a project examining the use of machine learning techniquesfor oil spill detection, we encountered several essential questions that webelieve deserve the attention of the research community. We use ourparticular case study to illustrate such issues as problem formulation,selection of evaluation measures, and data preparation. We relate theseissues to properties of the oil spill application, such as its imbalancedclass distribution, that are shown to be common to many applications. Oursolutions to these issues are implemented in the Canadian EnvironmentalHazards Detection System (CEHDS), which is about toundergo field testing.