Inference Extrapolation Position Embeddings Attention with Linear Biases public – 2 min read ALiBi, or Attention with Linear Biases, is a new method for inference extrapolation in Transformer models. This method is used… Apr 23, 2023 Devin Schumacher