1. Encoder-Decoder Transformer vs. Standalone Transformer

Roughly speaking, there are two types of transformer-based models: Encoder-Decoder structure and Standalone structure. The standalone transformer is also divided into Encoder-only and Decoder-only.

#transformers #llm #ai