Transformers are a model architecture in Machine Learning used for processing and generating sequential data, such as text.