A new kind of neuron model with a tunable activation function and its applications
A new kind of neuron model with a tunable activation function and its applications作者机构:Image Processing Division Department of Electronic Engineering Tsmghua University Beijing 100084 China
出 版 物:《Science China(Technological Sciences)》 (中国科学(技术科学英文版))
年 卷 期:1997年第40卷第1期
页 面:105-112页
核心收录:
学科分类:08[工学] 080203[工学-机械设计及理论] 0802[工学-机械工程]
基 金:Project supported hy the National Natural Science Foundation of China
主 题:BP networks activation function connection weight two-spiral problem TAF network.
摘 要:A new neuron model with a tunable activation function, denoted by the TAF model, and its application are addressed. The activation function as well as the connection weights of the neuron model can be adjusted in the training process The two-spiral problem was used as an example to show how to deduce the adjustable activation function required, and how to construct and train the network by the use of the a priori knowledge of the problem. Due to the incorporation of constraints known a priori into the activation function, many novel aspects are revealed, such as small network size, fast learning and good performances. It is believed that the introduction of the new neuron model will pave a new way in ANN studies.