diff --git a/recipes_source/distributed_comm_debug_mode.rst b/recipes_source/distributed_comm_debug_mode.rst index 7ebeb0b95a..431b433aca 100644 --- a/recipes_source/distributed_comm_debug_mode.rst +++ b/recipes_source/distributed_comm_debug_mode.rst @@ -3,10 +3,14 @@ Using CommDebugMode **Author**: `Anshul Sinha `__ + +In this tutorial, we will explore how to use CommDebugMode with PyTorch's DistributedTensor (DTensor) for debugging by tracking collective operations in distributed training environments. + Prerequisites +--------------------- -- Python 3.8 - 3.11 -- PyTorch 2.2 or later +* Python 3.8 - 3.11 +* PyTorch 2.2 or later What is CommDebugMode and why is it useful