Encoder Only

Three Architectural Patterns: How Transformers Power Far More Than Language Models

The Transformer architecture has evolved into three core patterns—encoder-only, decoder-only, and encoder-decoder—each suited for distinct tasks like understanding, generation, or sequence transformation. These versatile patterns extend beyond language models, finding applications in computer vision and other domains.