Abstract: Transformer neural networks have become the benchmark across a variety of domains in part thanks to their competence in comprehending the importance and dependencies between large input ...