Word Embeddings UNiversal Image-TExt Representation Learning public – 3 min read What is UNITER Have you ever wished that a computer could understand both images and text just like humans do?… Apr 23, 2023 Devin Schumacher
Contextualized Word Embeddings Self-Supervised Learning Sentence Embeddings Static Word Embeddings Word Embeddings Mirror-BERT public – 2 min read Introduction to Mirror-BERT: A Simple Yet Effective Text Encoder Language is the primary tool humans use to communicate, and it… Apr 23, 2023 Devin Schumacher
Word Embeddings Categorical Modularity public – 2 min read Categorical modularity is a complex concept related to word embeddings, which are commonly used in natural language processing. Word embeddings… Apr 23, 2023 Devin Schumacher
Word Embeddings Temporal Word Embeddings with a Compass public – 3 min read Overview of TWEC If you've ever heard of word embedding or vector representation, you'd know that it transforms a word… Apr 23, 2023 Devin Schumacher
Contextualized Word Embeddings Word Embeddings context2vec public – 3 min read Context2vec is an unsupervised model for learning generic context embeddings of wide sentential contexts, using a bidirectional LSTM. This technology… Apr 23, 2023 Devin Schumacher
Contextualized Word Embeddings Large Language Models (LLMs) Word Embeddings Cross-View Training public – 2 min read Cross-View Training, also known as CVT, is a modern way to improve artificial intelligence systems through the use of semi-supervised… Apr 23, 2023 Devin Schumacher
Static Word Embeddings Word Embeddings Continuous Bag-of-Words Word2Vec public – 2 min read Continuous Bag-of-Words Word2Vec, also known as CBOW Word2Vec, is a technique used to create word embeddings that can be used… Apr 23, 2023 Devin Schumacher
Document Embeddings Static Word Embeddings Topic Embeddings Word Embeddings lda2vec public – 3 min read What is lda2vec? lda2vec is a machine learning algorithm that creates word vectors while also taking into account the topic… Apr 23, 2023 Devin Schumacher
Static Word Embeddings Word Embeddings Skip-gram Word2Vec public – 2 min read Have you ever wondered how computers can understand the meaning behind the words we use? Word embeddings, like those created… Apr 23, 2023 Devin Schumacher
Static Word Embeddings Word Embeddings Poincaré Embeddings public – 2 min read What are Poincaré Embeddings? Poincaré Embeddings are a type of machine learning technique that can help computers understand the relationships… Apr 23, 2023 Devin Schumacher
Contextualized Word Embeddings Word Embeddings Contextual Word Vectors public – 2 min read What is CoVe? CoVe, or Contextualized Word Vectors, is a machine learning technique used to generate word embeddings that capture… Apr 23, 2023 Devin Schumacher
Static Word Embeddings Word Embeddings fastText public – 2 min read FastText: An Overview of Subword-based Word Embeddings FastText is a type of word embedding that utilizes subword information. Word embeddings… Apr 23, 2023 Devin Schumacher
Contextualized Word Embeddings Large Language Models (LLMs) Word Embeddings ELMo public – 2 min read What is ELMo? ELMo stands for Embeddings from Language Models, which is a special type of word representation that was… Apr 23, 2023 Devin Schumacher
Static Word Embeddings Word Embeddings GloVe Embeddings public – 2 min read What are GloVe Embeddings? GloVe Embeddings are a type of word embedding that represent words as vectors in a high-dimensional… Apr 23, 2023 Devin Schumacher