Transformer Explanation

The hidden states from the enter are created by the step in green. Instead of just one hidden state, we move all of the hidden…