Abstract: In recent years, transformer-based models pre-trained on extensive corpora have played a critical role in the advancement of Natural Language Processing methodologies. Particularly, methods ...