Course Outline

Introduction

  • Overview of Horovod features and concepts
  • Understanding the supported frameworks

Installing and Configuring Horovod

  • Preparing the hosting environment    
  • Building Horovod for TensorFlow, Keras, PyTorch, and Apache MXNet
  • Running Horovod

Running Distributed Training

  • Modifying and running training examples with TensorFlow
  • Modifying and running training examples with Keras
  • Modifying and running training examples with PyTorch
  • Modifying and running training examples with Apache MXNet

Optimizing Distributed Training Processes

  • Running concurrent operations on multiple GPUs    
  • Tuning hyperparameters
  • Enabling performance autotuning

Troubleshooting

Summary and Conclusion

Requirements

  • An understanding of Machine Learning, specifically deep learning
  • Familiarity with machine learning libraries (TensorFlow, Keras, PyTorch, Apache MXNet)
  • Python programming experience

Audience

  • Developers
  • Data scientists
  7 Hours
 

Testimonials

Related Courses

Artificial Intelligence (AI) in Automotive

  14 hours

Artificial Neural Networks, Machine Learning, Deep Thinking

  21 hours

Introduction to Deep Learning

  21 hours

Advanced Deep Learning

  28 hours

Amazon DSSTNE: Build a Recommendation System

  7 hours

Introduction Deep Learning and Neural Network for Engineers

  21 hours

Microsoft Cognitive Toolkit 2.x

  21 hours

Machine Learning and Deep Learning

  21 hours

T2T: Creating Sequence to Sequence Models for Generalized Learning

  7 hours

Deep Learning for Vision with Caffe

  21 hours

Deep Learning for Vision

  21 hours

Facebook NMT: Setting up a Neural Machine Translation System

  7 hours

OpenNMT: Setting Up a Neural Machine Translation System

  7 hours

OpenNN: Implementing Neural Networks

  14 hours

PaddlePaddle

  21 hours