Distributed Methods Model Parallel Methods Synchronous Pipeline Parallel Chimera public – 3 min read Understanding Chimera: A Pipeline Model Parallelism Scheme Chimera is a model parallelism scheme designed to train large-scale models efficiently. Its… Apr 23, 2023 Devin Schumacher
Distributed Methods Model Parallel Methods Synchronous Pipeline Parallel GPipe public – 2 min read GPipe is a distributed model parallel method for neural networks that allows for faster and more efficient training of deep… Apr 23, 2023 Devin Schumacher