Digital neural networks
Discriminative learning for minimum error classification [patternrecognition]
IEEE Transactions on Signal Processing
Hi-index | 0.00 |
In a decision-based neural network(DBNN)[5], the teacher only tells the correctness of the classification for each training pattern. In dealing with practical classification applications where significant overlap may exist between categories, a special care is needed to cope with the "marginal" training patterns. For these situations, a soft decision is more appropriate. This motivates a fuzzy-decision neural network(FDNN) which incorporates a penalty criterion into the DBNNs. Following [2], a penalty function is proposed which treats the errors with equal penalty once the the magnitude of error exceeds certain threshold. Theoretically, the FDNNs are less biased and they yield the minimum error rate when the number of the training patterns is very large. Simulation results confirm that the FDNN works more effectively than the DBNN when the the training patterns are not separable.