HorovodRunner examples

Important

Horovod and HorovodRunner are now deprecated. Releases after 15.4 LTS ML will not have this package pre-installed. For distributed deep learning, Databricks recommends using TorchDistributor for distributed training with PyTorch or the tf.distribute.Strategy API for distributed training with TensorFlow.

The examples in this section demonstrate how to use HorovodRunner to perform distributed training using a convolutional neural network model on the MNIST dataset, a large database of handwritten digits.

• Deep learning using TensorFlow with HorovodRunner for MNIST
• Adapt single node PyTorch to distributed deep learning