Examples#

Start with an example machine learning model converted to Determined’s APIs. Code examples are in the examples/ subdirectory of the Determined GitHub repo. Download links are below.

For more examples, visit the determined-examples repo.

Each example includes a model definition and one or more experiment configuration files. To run an example, download the appropriate .tgz file, extract it, cd into the directory, and use det experiment create to create a new experiment, passing in the appropriate configuration file. For example, here is how to train the mnist_pytorch example with a fixed set of hyperparameters:

tar xzvf mnist_pytorch.tgz
cd mnist_pytorch
det experiment create const.yaml .

For an introduction to using the training APIs, please visit Training APIs.

Computer Vision#

Framework

Dataset

Filename

PyTorch

MNIST

mnist_pytorch.tgz

DeepSpeed#

Framework

Dataset

Filename

DeepSpeed (PyTorch)

Enron Email Corpus

gpt_neox.tgz

Hugging Face (DeepSpeed/PyTorch)

Beans (Hugging Face)

hf_image_classification.tgz

Hugging Face (DeepSpeed/PyTorch)

WikiText (Hugging Face)

hf_language_modeling.tgz

Diffusion#

Framework

Dataset

Filename

PyTorch

det_logos

textual_inversion_stable_diffusion.tgz