Momentum Rules Demon public – 2 min read Demon Overview: Decaying Momentum for Optimizing Gradient Descent Demon, short for Decaying Momentum, is a stochastic optimizer designed to decay… Apr 23, 2023 Devin Schumacher
