Algebraic Analysis for Nonidentifiable Learning Machines
Neural Computation
On a singular point to contribute to a learning coefficient and weighted resolution of singularities
ICANN'07 Proceedings of the 17th international conference on Artificial neural networks
Hi-index | 0.00 |
A lot of learning machines which have hidden variables or hierarchical structures are singular statistical models. They have singular Fisher information matrices and different learning performance from regular statistical models. In this paper, we prove mathematically that the learning coefficient is determined by the analytic equivalence class of Kullback information, and show experimentally that the stochastic complexity by the MCMC method is also given by the equivalence class.