When we think of transformers, most people think of their transformative impact on Natural Language…