Long Short-Term Memory Network (LSTM)

The LSTM unit is used for the same purpose as the GRU i.e. to learn long-term dependencies, but it is more powerful than the GRU unit.

The image below shows an LSTM unit:

There are 3 gates: forget gate, update gate and output gate.

These are the equations associated with an LSTM unit: