Part of Advances in Neural Information Processing Systems 8 (NIPS 1995)
Hiroyuki Nakahara, Kenji Doya
In consideration of attention as a means for goal-directed behav(cid:173) ior in non-stationary environments, we argue that the dynamics of attention should satisfy two opposing demands: long-term main(cid:173) tenance and quick transition. These two characteristics are con(cid:173) tradictory within the linear domain. We propose the near saddle(cid:173) node bifurcation behavior of a sigmoidal unit with self-connection as a candidate of dynamical mechanism that satisfies both of these demands. We further show in simulations of the 'bug-eat-food' tasks that the near saddle-node bifurcation behavior of recurrent networks can emerge as a functional property for survival in non(cid:173) stationary environments.