NeurIPS 2019
Sun Dec 8th through Sat the 14th, 2019 at Vancouver Convention Center
Paper ID:59
Title:GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism

While the proposed pipelining framework is simple, the reviewers unanimously assert that from an empirical point of view it is an important advance, especially in language modeling tasks.