Custom Training Loops

Train deep learning networks using custom training loops

If the trainingOptions function does not provide the training options that you need for your task, or you have a loss function that the trainnet function does not support, then you can define a custom training loop. For models that cannot be specified as networks of layers, you can define the model as a function. To learn more, see Define Custom Training Loops, Loss Functions, and Networks.

Functions

expand all

Custom Training Loops

`dlnetwork`	Deep learning neural network
`trainingProgressMonitor`	Monitor and plot training progress for deep learning custom training loops (Since R2022b)
`minibatchqueue`	Create mini-batches for deep learning (Since R2020b)
`padsequences`	Pad or truncate sequence data to same length (Since R2021a)
`dlarray`	Deep learning array for customization
`dlgradient`	Compute gradients for custom training loops using automatic differentiation
`dlfeval`	Evaluate deep learning model for custom training loops

Loss Operations

`crossentropy`	Cross-entropy loss for classification tasks
`indexcrossentropy`	Index cross-entropy loss for classification tasks (Since R2024b)
`l1loss`	L₁ loss for regression tasks (Since R2021b)
`l2loss`	L₂ loss for regression tasks (Since R2021b)
`huber`	Huber loss for regression tasks (Since R2021a)
`ctc`	Connectionist temporal classification (CTC) loss for unaligned sequence classification (Since R2021a)
`mse`	Half mean squared error

Topics

Train Network Using Custom Training Loop
This example shows how to train a network that classifies handwritten digits with a custom learning rate schedule.
Train Sequence Classification Network Using Custom Training Loop
This example shows how to train a network that classifies sequences with a custom learning rate schedule.
Define Custom Training Loops, Loss Functions, and Networks
Learn how to define and customize deep learning training loops, loss functions, and models.
Specify Training Options in Custom Training Loop
Learn how to specify common training options in a custom training loop.
Monitor Custom Training Loop Progress
Track and plot custom training loop progress.
Detect Issues During Deep Neural Network Training
This example shows how to automatically detect issues while training a deep neural network.
Speed Up Deep Neural Network Training
Learn how to accelerate deep neural network training.