Within this text neural networks are considered as massively interconnected nonlinear adaptive filters. Offers a new insight into the learning algorithms, architectures and stability of recurrent neural networks and, consequently, will have instant appeal.