Simplifying convnets for fast learning

Authors:
Franck Mamalet;Christophe Garcia
Affiliations:
Orange Labs, Cesson-Sévigné, France;LIRIS, CNRS, Insa de Lyon, Villeurbanne, France
Venue:
ICANN'12 Proceedings of the 22nd international conference on Artificial Neural Networks and Machine Learning - Volume Part II
Year:
2012

Citing 4
Cited 0

Convolutional Face Finder: A Neural Architecture for Fast and Robust Face Detection

IEEE Transactions on Pattern Analysis and Machine Intelligence
Real-time video convolutional face finder on embedded platforms

EURASIP Journal on Embedded Systems
Learning long-range vision for autonomous off-road driving

Journal of Field Robotics - Special Issue on LAGR Program, Part II
Pruning algorithms-a survey

IEEE Transactions on Neural Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we propose different strategies for simplifying filters, used as feature extractors, to be learnt in convolutional neural networks (ConvNets) in order to modify the hypothesis space, and to speed-up learning and processing times. We study two kinds of filters that are known to be computationally efficient in feed-forward processing: fused convolution/sub-sampling filters, and separable filters. We compare the complexity of the back-propagation algorithm on ConvNets based on these different kinds of filters. We show that using these filters allows to reach the same level of recognition performance as with classical ConvNets for handwritten digit recognition, up to 3.3 times faster.