Very Nice Article. I found an interesting video on the related topic.
What is Self Attention Bottleneck for Transformers Deep Learning Models
Written by Dhiraj K
Data Scientist & Machine Learning Evangelist. I love transforming data into impactful solutions and sharing my knowledge through teaching. dhiraj10099@gmail.com