Image Classification and CNN
Building a CNN Classifier with PyTorch: Part 1
Building a CNN Classifier with PyTorch: Part 2
Introduction to DDP with PyTorch
Single Node Multi-GPU Training with torchrun
Multi-node Distributed Training with PyTorch
Lab Setup

Optional Exercise

There is a script called simple_linear_regression_serial.py that implements a simple linear regression model with PyTorch. We will modify this script to run on multiple GPUs on one node using PyTorch’s DDP.


Below is the modified code to run on multiple GPUs on one node using DDP.

Back
 
Next
© Chishiki-AI  |   Cornell University    |   Center for Advanced Computing    |   Copyright Statement    |   Access Statement
CVW material development is supported by NSF OAC awards 1854828, 2321040, 2323116 (UT Austin) and 2005506 (Indiana University)