Differentiation in PASCAL-SC: type GRADIENT
ACM Transactions on Mathematical Software (TOMS)
Automatic evaluation of derivatives
Applied Mathematics and Computation
A simple automatic derivative evaluation program
Communications of the ACM
Methods and Applications of Interval Analysis (SIAM Studies in Applied and Numerical Mathematics) (Siam Studies in Applied Mathematics, 2.)
Differential equations are recurrence relations in APL
APL '92 Proceedings of the international conference on APL
Using defined operators and function arrays to solve non-linear equations in APL2
APL '93 Proceedings of the international conference on APL
Applying matrix divide in APL and J
APL '94 Proceedings of the international conference on APL : the language and its applications: the language and its applications
Computing multivariable Taylor series to arbitrary order
APL '95 Proceedings of the international conference on Applied programming languages
Hi-index | 0.00 |
An APL workspace is developed for the purpose of calculating numerical values of derivatives. The heart of the method, called automatic differentiation, is manipulation of numerical vectors --- an APL way of thinking. The method is not symbolic manipulation as taught in calculus, nor is it approximation as taught in numerical analysis. Automatic differentiation is implemented as a workspace (called GRADIENT) of 14 simple, one-line, numerical vector functions that perform all of the formal differentiation rules. The ideas are introduced for simple first derivatives of single variable functions. We then show that the GRADIENT workspace enables the calculation of all first-order partial derivatives of any typical function in any number of variables. This workspace is used as a tool in the solution of systems of nonlinear equations by Newton's method. Finally, we discuss how APL concepts led to a new approach to higher-order derivatives. This approach enables the calculation of higher-order derivatives for problems that overwhelm commercial symbolic differentiation programs; moreover, the resulting accuracy cannot be obtained by numerical approximation techniques.