In this subsection, the initialization, learning, and update functions for partial recurrent networks are described. These functions can not be applied to only the three network models described in the previous subsection. They can be applied to a broader class of partial recurrent networks. Every partial recurrent network, that has the following restrictions, can be used:
In such networks all links leading to context units are considered as recurrent links.
Thereby the user has a lot of possibilities to experiment with a great variety of partial recurrent networks. E.g. it is allowed to connect context units with other context units.
Note: context units are realized as special hidden units. All units of type special hidden are assumed to be context units and are treated like this.