Our brands
Technical · Architecture

Transformer

The Transformer is the neural-network architecture behind modern large language models.

The Transformer is a deep-learning architecture introduced in 2017. Its key innovation, the attention mechanism, lets the model weigh the importance of each word relative to the others.

This ability to capture long-range dependencies in a text made LLMs such as GPT or Claude possible.

The Transformer is today the foundation of almost all state-of-the-art language models.

Envie de passer de la théorie à la pratique ?

Nos experts déploient ces concepts dans des solutions concrètes pour votre entreprise.