Composable Distributed PT2(D) - Wanchao Liang, Meta Platforms, Inc.
Ойын-сауық
Composable Distributed PT2(D) - Wanchao Liang, Meta Platforms, Inc.
In this session, we will explore the technology advancements of PyTorch Distributed, and dive into the details of how multi-dimensional parallelism is made possible to train Large Language Models by composing different PyTorch native distributed training APIs.
Пікірлер