2D Parallel Distributed Methods End-to-end Adaptive Distributed Training public – 1 min read Distributed training is a popular method for training large neural networks efficiently by processing large amounts of data. However, meeting… Apr 23, 2023 Devin Schumacher
2D Parallel Distributed Methods Distributed Methods Hybrid Parallel Methods PipeTransformer public – 1 min read What is PipeTransformer? PipeTransformer is a novel method for training artificial intelligence models, specifically Transformer models, in a distributed and… Apr 23, 2023 Devin Schumacher
2D Parallel Distributed Methods Distributed Methods Hybrid Parallel Methods FastMoE public – 2 min read FastMoE is a powerful distributed training system built on PyTorch that accelerates the training process of massive models with commonly… Apr 23, 2023 Devin Schumacher