Add github links to distributed tutorials (#1884)

holly1238 · web-flow · commit 8b0894ede9d6 · 2022-04-12T16:39:45.000-07:00
* added github link to dist_overview

* added github link to dpp_tutorial

* Added github link to dist_tuto

* Added github link to FSDP_tutorial

* Added github link to process_group_cpp_extension_tutorial

* Added github link for rpc_tutorial

* Added github link to rpc_param_server_tutorial

* Added github link to dist_pipeline_parallel_tutorial

* Added github link to rpc_async_execution

* Added github link to rpc_dpp_tutorial

* Added github link to generic_join
diff --git a/advanced_source/generic_join.rst b/advanced_source/generic_join.rst
@@ -3,6 +3,9 @@ Distributed Training with Uneven Inputs Using the Join Context Manager
 
 **Author**\ : `Andrew Gu <https://github.com/andwgu>`_
 
+.. note::
+   View the source code for this tutorial in `github <https://github.com/pytorch/tutorials/blob/master/advanced_source/generic_join.rst>`__.
+
 .. note:: ``Join`` is introduced in PyTorch 1.10 as a prototype feature. This
     API is subject to change.
 
@@ -444,4 +447,4 @@ Some key points to highlight:
 .. _Shard Optimizer States with ZeroRedundancyOptimizer: https://pytorch.org/tutorials/recipes/zero_redundancy_optimizer.html
 .. _DistributedDataParallel: https://pytorch.org/docs/stable/generated/torch.nn.parallel.DistributedDataParallel.html
 .. _join(): https://pytorch.org/docs/stable/_modules/torch/nn/parallel/distributed.html#DistributedDataParallel.join
-.. _ZeroRedundancyOptimizer: https://pytorch.org/docs/stable/distributed.optim.html
+.. _ZeroRedundancyOptimizer: https://pytorch.org/docs/stable/distributed.optim.html
diff --git a/advanced_source/rpc_ddp_tutorial.rst b/advanced_source/rpc_ddp_tutorial.rst
@@ -2,6 +2,8 @@ Combining Distributed DataParallel with Distributed RPC Framework
 =================================================================
 **Authors**: `Pritam Damania <https://github.com/pritamdamania87>`_ and `Yi Wang <https://github.com/SciPioneer>`_
 
+.. note::
+   View the source code for this tutorial in `github <https://github.com/pytorch/tutorials/blob/master/advanced_source/rpc_ddp_tutorial.rst>`__.
 
 This tutorial uses a simple example to demonstrate how you can combine
 `DistributedDataParallel <https://pytorch.org/docs/stable/nn.html#torch.nn.parallel.DistributedDataParallel>`__ (DDP)
diff --git a/beginner_source/dist_overview.rst b/beginner_source/dist_overview.rst
@@ -2,6 +2,8 @@ PyTorch Distributed Overview
 ============================
 **Author**: `Shen Li <https://mrshenli.github.io/>`_
 
+.. note::
+   View the source code for this tutorial in `github <https://github.com/pytorch/tutorials/blob/master/beginner_source/dist_overview.rst>`__.
 
 This is the overview page for the ``torch.distributed`` package. The goal of
 this page is to categorize documents into different topics and briefly
diff --git a/intermediate_source/FSDP_tutorial.rst b/intermediate_source/FSDP_tutorial.rst
@@ -3,6 +3,8 @@ Getting Started with Fully Sharded Data Parallel(FSDP)
 
 **Author**: `Hamid Shojanazeri <https://github.com/HamidShojanazeri>`__, `Yanli Zhao <https://github.com/zhaojuanmao>`__, `Shen Li <https://mrshenli.github.io/>`__
 
+.. note::
+   View the source code for this tutorial in `github <https://github.com/pytorch/tutorials/blob/master/intermediate_source/FSDP_tutorial.rst>`__.
 
 Training AI models at a large scale is a challenging task that requires a lot of compute power and resources. 
 It also comes with considerable engineering complexity to handle the training of these very large models.
diff --git a/intermediate_source/ddp_tutorial.rst b/intermediate_source/ddp_tutorial.rst
@@ -4,6 +4,9 @@ Getting Started with Distributed Data Parallel
 
 **Edited by**: `Joe Zhu <https://github.com/gunandrose4u>`_
 
+.. note::
+   View the source code for this tutorial in `github <https://github.com/pytorch/tutorials/blob/master/intermediate_source/ddp_tutorial.rst>`__.
+
 Prerequisites:
 
 -  `PyTorch Distributed Overview <../beginner/dist_overview.html>`__
diff --git a/intermediate_source/dist_pipeline_parallel_tutorial.rst b/intermediate_source/dist_pipeline_parallel_tutorial.rst
@@ -2,6 +2,9 @@ Distributed Pipeline Parallelism Using RPC
 ==========================================
 **Author**: `Shen Li <https://mrshenli.github.io/>`_
 
+.. note::
+   View the source code for this tutorial in `github <https://github.com/pytorch/tutorials/blob/master/intermediate_source/dist_pipeline_parallel_tutorial.rst>`__.
+
 Prerequisites:
 
 -  `PyTorch Distributed Overview <../beginner/dist_overview.html>`__
diff --git a/intermediate_source/dist_tuto.rst b/intermediate_source/dist_tuto.rst
@@ -2,6 +2,9 @@ Writing Distributed Applications with PyTorch
 =============================================
 **Author**: `Séb Arnold <https://seba1511.com>`_
 
+.. note::
+   View the source code for this tutorial in `github <https://github.com/pytorch/tutorials/blob/master/intermediate_source/dist_tuto.rst>`__.
+
 Prerequisites:
 
 -  `PyTorch Distributed Overview <../beginner/dist_overview.html>`__
diff --git a/intermediate_source/process_group_cpp_extension_tutorial.rst b/intermediate_source/process_group_cpp_extension_tutorial.rst
@@ -3,6 +3,8 @@ Customize Process Group Backends Using Cpp Extensions
 
 **Author**: `Feng Tian <https://github.com/ftian1>`__, `Shen Li <https://mrshenli.github.io/>`__
 
+.. note::
+   View the source code for this tutorial in `github <https://github.com/pytorch/tutorials/blob/master/intermediate_source/process_group_cpp_extension_tutorial.rst>`__.
 
 Prerequisites:
 
diff --git a/intermediate_source/rpc_async_execution.rst b/intermediate_source/rpc_async_execution.rst
@@ -2,6 +2,8 @@ Implementing Batch RPC Processing Using Asynchronous Executions
 ===============================================================
 **Author**: `Shen Li <https://mrshenli.github.io/>`_
 
+.. note::
+   View the source code for this tutorial in `github <https://github.com/pytorch/tutorials/blob/master/intermediate_source/rpc_async_execution.rst>`__.
 
 Prerequisites:
 
@@ -520,4 +522,4 @@ Learn More
 -  `Batch-Updating Parameter Server Source Code <https://github.com/pytorch/examples/blob/master/distributed/rpc/batch/parameter_server.py>`__
 -  `Batch-Processing CartPole Solver <https://github.com/pytorch/examples/blob/master/distributed/rpc/batch/reinforce.py>`__
 -  `Distributed Autograd <https://pytorch.org/docs/master/rpc.html#distributed-autograd-framework>`__
--  `Distributed Pipeline Parallelism <dist_pipeline_parallel_tutorial.html>`__
+-  `Distributed Pipeline Parallelism <dist_pipeline_parallel_tutorial.html>`__
diff --git a/intermediate_source/rpc_param_server_tutorial.rst b/intermediate_source/rpc_param_server_tutorial.rst
@@ -4,6 +4,9 @@ Implementing a Parameter Server Using Distributed RPC Framework
 
 **Author**\ : `Rohan Varma <https://github.com/rohan-varma>`_
 
+.. note::
+   View the source code for this tutorial in `github <https://github.com/pytorch/tutorials/blob/master/intermediate_source/rpc_param_server_tutorial.rst>`__.
+
 Prerequisites:
 
 -  `PyTorch Distributed Overview <../beginner/dist_overview.html>`__
diff --git a/intermediate_source/rpc_tutorial.rst b/intermediate_source/rpc_tutorial.rst
@@ -2,6 +2,8 @@ Getting Started with Distributed RPC Framework
 =================================================
 **Author**: `Shen Li <https://mrshenli.github.io/>`_
 
+.. note::
+   View the source code for this tutorial in `github <https://github.com/pytorch/tutorials/blob/master/intermediate_source/rpc_tutorial.rst>`__.
 
 Prerequisites:
 
