Since 2020, manufacturers have been steadily releasing bigger and bigger models like the GPT-3 (175B), LaMDA (137B), Jurassic-1 (178B), Megatron-Turing…
Cross-encoder Reranking: Improving Language Understanding
As technology progresses, many companies have been looking to improve their language understanding capabilities. One…
Canine: A Language Understanding Encoder
Canine is a pre-trained encoder for language understanding. It operates directly on character sequences, without…
mBART is a machine learning tool that uses a sequence-to-sequence denoising auto-encoder pre-trained on large-scale monolingual corpora in many languages…
CharacterBERT is an exciting new development in natural language processing (NLP) that promises to use state-of-the-art machine learning techniques to…
mBERT, or Multilingual Bidirectional Encoder Representations from Transformers, is a powerful language model developed by Google that can understand and…
Overview of Universal Language Model Fine-Tuning (ULMFiT)
Universal Language Model Fine-tuning, or ULMFiT, is a technique for natural language processing…