Some Features of Neural Networks as Nonlinearly Parameterized Models of Unknown Systems Using an Online Learning Algorithm
Some Features of Neural Networks as Nonlinearly Parameterized Models of Unknown Systems Using an Online Learning Algorithm作者机构：Department of Intelligent Automatic Systems International Centre of Information Technologies and Systems Institute of Cybernetics Kiev Ukraine Aircraft Control Systems Department National Aviation University Kiev Ukraine
出 版 物：《Journal of Applied Mathematics and Physics》 (应用数学与应用物理（英文）)
年 卷 期：2018年第6卷第1期
页 面：247-263页
学科分类：07[理学] 0701[理学-数学] 070101[理学-基础数学]
主 题：Neural Network Nonlinear Model Online Learning Algorithm Lyapunov Func-tion Probabilistic Convergence
摘 要：This paper deals with deriving the properties of updated neural network model that is exploited to identify an unknown nonlinear system via the standard gradient learning algorithm. The convergence of this algorithm for online training the three-layer neural networks in stochastic environment is studied. A special case where an unknown nonlinearity can exactly be approximated by some neural network with a nonlinear activation function for its output layer is considered. To analyze the asymptotic behavior of the learning processes, the so-called Lyapunov-like approach is utilized. As the Lyapunov function, the expected value of the square of approximation error depending on network parameters is chosen. Within this approach, sufficient conditions guaranteeing the convergence of learning algorithm with probability 1 are derived. Simulation results are presented to support the theoretical analysis.
维普期刊数据库