System identification: theory for the user
System identification: theory for the user
Algorithms for clustering data
Algorithms for clustering data
C4.5: programs for machine learning
C4.5: programs for machine learning
Combining the results of several neural network classifiers
Neural Networks
Combination of Multiple Classifiers Using Local Accuracy Estimates
IEEE Transactions on Pattern Analysis and Machine Intelligence
A decision-theoretic generalization of on-line learning and an application to boosting
Journal of Computer and System Sciences - Special issue: 26th annual ACM symposium on the theory of computing & STOC'94, May 23–25, 1994, and second annual Europe an conference on computational learning theory (EuroCOLT'95), March 13–15, 1995
IEEE Transactions on Pattern Analysis and Machine Intelligence
Adaptive resonance theory (ART)
The handbook of brain theory and neural networks
Information Processing and Human-Machine Interaction: An Approach to Cognitive Engineering
Information Processing and Human-Machine Interaction: An Approach to Cognitive Engineering
Computer Vision and Human-Computer Interaction
Computer Vision and Human-Computer Interaction
Evolving Connectionist Systems: Methods and Applications in Bioinformatics, Brain Study and Intelligent Machines
Ensembles of Learning Machines
WIRN VIETRI 2002 Proceedings of the 13th Italian Workshop on Neural Nets-Revised Papers
An Evaluation of Grading Classifiers
IDA '01 Proceedings of the 4th International Conference on Advances in Intelligent Data Analysis
Support vector machine active learning with applications to text classification
The Journal of Machine Learning Research
Pattern Classification (2nd Edition)
Pattern Classification (2nd Edition)
Combining Pattern Classifiers: Methods and Algorithms
Combining Pattern Classifiers: Methods and Algorithms
On-line machine vision system for detect split defects in sheet-metal forming processes
ICPR '06 Proceedings of the 18th International Conference on Pattern Recognition - Volume 01
Improving Nearest Neighbor Classifier Using Tabu Search and Ensemble Distance Metrics
ICDM '06 Proceedings of the Sixth International Conference on Data Mining
Pattern Recognition Letters
Post-pruning in decision tree induction using multiple performance measures
Computers and Operations Research
Adaptive surface inspection via interactive evolution
Image and Vision Computing
Multimodal human-computer interaction: A survey
Computer Vision and Image Understanding
Extensions of vector quantization for incremental clustering
Pattern Recognition
Top 10 algorithms in data mining
Knowledge and Information Systems
The lack of a priori distinctions between learning algorithms
Neural Computation
Stop wasting time: on predicting the success or failure of learning for industrial applications
IDEAL'07 Proceedings of the 8th international conference on Intelligent data engineering and automated learning
An on-line interactive self-adaptive image classification framework
ICVS'08 Proceedings of the 6th international conference on Computer vision systems
A novel feature selection based semi-supervised method for image classification
ICVS'08 Proceedings of the 6th international conference on Computer vision systems
Impact of object extraction methods on classification performance in surface inspection systems
Machine Vision and Applications - Integrated Imaging and Vision Techniques for Industrial Inspection
Algorithm that mimics human perceptual grouping of dot patterns
BVAI'05 Proceedings of the First international conference on Brain, Vision, and Artificial Intelligence
Fuzzy decision tree, linguistic rules and fuzzy knowledge-based network: generation and evaluation
IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Modeling visual interactive systems through dynamic visual languages
IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans
Automating Scenario Analysis of Human and System Reliability
IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans
Visual Interactive Systems for End-User Development: A Model-Based Design Methodology
IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans
IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans
A Systematic Fuzzy Decision-Making Process to Choose the Best Model Among a Set of Competing Models
IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans
FLEXFIS: A Robust Incremental Learning Approach for Evolving Takagi–Sugeno Fuzzy Models
IEEE Transactions on Fuzzy Systems
Incremental training of support vector machines
IEEE Transactions on Neural Networks
Sensitivity versus accuracy in multiclass problems using memetic Pareto evolutionary neural networks
IEEE Transactions on Neural Networks
Handling drifts and shifts in on-line data streams with evolving fuzzy systems
Applied Soft Computing
Machine learning based analysis of gender differences in visual inspection decision making
Information Sciences: an International Journal
Information Sciences: an International Journal
| Hi-index | 0.00 |
This paper considers on a number of issues that arise when a trainable machine vision system learns directly from humans. We contrast this to the "normal" situation where machine learning (ML) techniques are applied to a "cleaned" data set which is considered to be perfectly labeled with complete accuracy. This paper is done within the context of a generic system for the visual surface inspection of manufactured parts; however, the issues treated are relevant not only to wider computer vision applications such as medical image screening but also to classification more generally. Many of the issues we consider arise from the nature of humans themselves: They will be not only internally inconsistent but also will often not be completely confident about their decisions, particularly if they are making decisions rapidly. People will also often differ systematically from each other in the decisions they make. Other issues may arise from the nature of the process, which may require the ML to have the capacity for real-time online adaptation in response to users' input. Because of this, it may be that the users cannot always provide input to a consistent level of detail. We describe how all of these issues may be tackled within a coherent methodology. By using a range of classifiers trained on data sets from a compact disc imprint production process, we present results which demonstrate that training methods designed to take proper consideration of these issues may actually lead to improved performance.