Simultaneous approximations of polynomials and derivatives and their applications to neural networks

Authors:
Yoshifusa Ito
Affiliations:
School of Medicine, Aichi Medical University, Nagakute-cho, Aichi-ken, 480-1195 Japan. ito@aichi-med-u.ac.jp
Venue:
Neural Computation
Year:
2008

Citing 22
Cited 3

Multilayer feedforward networks are universal approximators

Neural Networks
On the approximate realization of continuous mappings by neural networks

Neural Networks
Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks

Neural Networks
Approximation capabilities of multilayer feedforward networks

Neural Networks
Arbitrary nonlinearity is sufficient to represent all functions by neural networks: a theorem

Neural Networks
Representation of functions by superpositions of a step or sigmoid function and their applications to neural network theory

Neural Networks
Universal approximation using radial-basis-function networks

Neural Computation
Approximation of functions on a compact set by finite sums of a sigmoid function without scaling

Neural Networks
Original Contribution: Approximation of continuous functions on Rd by linear combinations of shifted rotations of a sigmoid function with and without scaling

Neural Networks
Original Contribution: Approximation of a function and its derivative with a neural network

Neural Networks
Original Contribution: Multilayer feedforward networks with a nonpolynomial activation function can approximate any function

Neural Networks
Differentiable approximation by means of the Radon transformation and its applications to neural networks

Journal of Computational and Applied Mathematics
Regular Article: Degree of Approximation by Neural and Translation Networks with a Single Hidden Layer

Advances in Applied Mathematics
Approximation of functions by a multilayer perceptron: a new approach

Neural Networks
Universal approximation using feedforward neural networks: a survey of some existing methods, and some new results

Neural Networks
Multilayer neural networks and Bayes decision theory

Neural Networks
Neural netowrk approximation of continuous functionals and continuous functions on compactifications

Neural Networks
Simultaneous Lp-approximation order for neural networks

Neural Networks
Minimization of error functionals over perceptron networks

Neural Computation
Bayesian decision theory on three-layer neural networks

Neurocomputing
Bayesian learning of neural networks adapted to changes of prior probabilities

ICANN'05 Proceedings of the 15th international conference on Artificial neural networks: formal models and their applications - Volume Part II
Discriminant analysis by a neural network with mahalanobis distance

ICANN'06 Proceedings of the 16th international conference on Artificial Neural Networks - Volume Part II

Multi-category Bayesian Decision by Neural Networks

ICANN '08 Proceedings of the 18th international conference on Artificial Neural Networks, Part I
A new algorithm for learning mahalanobis discriminant functions by a neural network

ICONIP'11 Proceedings of the 18th international conference on Neural Information Processing - Volume Part II
Simultaneous learning of several bayesian and mahalanobis discriminant functions by a neural network with memory nodes

ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part V

Quantified Score

Hi-index	0.00

Visualization

Abstract

We have constructed one-hidden-layer neural networks capable of approximating polynomials and their derivatives simultaneously. Generally, optimizing neural network parameters to be trained at later steps of the BP training is more difficult than optimizing those to be trained at the first step. Taking into account this fact, we suppressed the number of parameters of the former type. We measure degree of approximation in both the uniform norm on compact sets and the Lp-norm on the whole space with respect to probability measures.