Large Scale Neural Network Training: Part II
Event TypePaper
Machine Learning and Artificial Intelligence
TP
TimeWednesday, 17 November 20211:30pm - 3pm CST
Location230-231-232
Presentations
| 1:30pm - 2:00pm CST | Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM | 
Best Student Paper Finalist
  | |
| 2:00pm - 2:30pm CST | ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning | | |
| 2:30pm - 3:00pm CST | FedAT: A High-Performance and Communication-Efficient Federated Learning System with Asynchronous Tiers |