Bidirectional RNNs

As noted earlier, if we use a simple RNN to predict the next word in a sentence, we will only be using information from words that occurred previously in the sentence.

BRNNs allow us to use information from words that occur later in the sentence as well.

The disadvantage is that we need the entire sequence of data to make use of it.