Gated Recurrent Units (GRUs)
Last updated
Last updated
GRUs help solve the vanishing gradient problem in RNNs. They allow for long-range dependencies.
The GRU unit is shown below:
The following are the equations associated with a single GRU unit.
r stands for the reset gate and u stands for update gate.