Output Functions Hierarchical Softmax public – 3 min read Have you ever wondered how computers can understand language? One way computers do this is through natural language processing, which… Apr 23, 2023 Devin Schumacher
Output Functions Adaptive Softmax public – 2 min read Adaptive Softmax: An Efficient Computation Technique for Probability Distributions Over Words If you have ever used a smartphone's text prediction… Apr 23, 2023 Devin Schumacher
Output Functions Mixture of Softmaxes public – 2 min read What is a Mixture of Softmaxes? In deep learning, a mixture of softmaxes is a mathematical operation that involves combining… Apr 23, 2023 Devin Schumacher
Output Functions Sparsemax public – 2 min read Sparsemax: A New Type of Activation Function with Sparse Probability Output Activation functions are an essential component in deep learning… Apr 23, 2023 Devin Schumacher
Output Functions Mixture of Logistic Distributions public – 2 min read The Mixture of Logistic Distributions (MoL) is an output function used in deep learning models to predict discrete values. It… Apr 23, 2023 Devin Schumacher
Output Functions Softmax public – 2 min read Overview of Softmax The Softmax function is commonly used in machine learning for multiclass classification. Its purpose is to transform… Apr 23, 2023 Devin Schumacher