Introduction to Linformer
Linformer is a linear Transformer model that resolves the self-attention bottleneck associated with Transformer models. It utilizes…
Overview of Primer: A Transformer-Based Architecture with Multi-DConv-Head-Attention
Primer is a new transformer-based architecture built using two improvements found through…
The Levenshtein Transformer: Enhancing Flexibility in Language Decoding
The Levenshtein Transformer (LevT) is a type of transformer that addresses the…