Long Short-Term Memory Network (LSTM)
Last updated
Last updated
The LSTM unit is used for the same purpose as the GRU i.e. to learn long-term dependencies, but it is more powerful than the GRU unit.
The image below shows an LSTM unit:
There are 3 gates: forget gate, update gate and output gate.
These are the equations associated with an LSTM unit:
