Self-Attention (or Self-Attention Layer)

A neural network layer that outputs new sequence of embeddings by applying attention mechanism to the information from the elements of the input sequence.

الانتباه الذاتي (أو طبقة الانتباه الذاتي)