https://pytorch.org/get-started/pytorch-2.0/

https://pytorch.org/docs/stable/distributed.optim.html#module-torch.distributed.optim

https://pytorch.org/tutorials/beginner/dist_overview.html

https://pytorch.org/ecosystem/

https://github.com/pytorch

https://youtu.be/EMXfZB8FVUA?si=_Df6jbYmatNqkUM1

https://www.youtube.com/@PyTorch/playlists

https://github.com/AIZOOTech/pytorch_mnist_ddp/blob/main/mnist_ddp.py