Posted On October 26, 2023
Composable Distributed PT2(D) - Wanchao Liang, Meta Platforms, Inc.
In this session, we will explore the technology advancements of PyTorch Distributed, and dive into the details of how multi-dimensional parallelism is made possible to train Large Language Models by composing different PyTorch native distributed training APIs.
