Main Content

Deep Learning Tuning

Programmatically tune training options, resume training from a checkpoint, and investigate adversarial examples

To learn how to set options using the trainingOptions function, see Set Up Parameters and Train Convolutional Neural Network. After you identify some good starting options, you can automate sweeping of hyperparameters or try Bayesian optimization using Experiment Manager.

Investigate network robustness by generating adversarial examples. You can then use fast gradient sign method (FGSM) adversarial training to train a network robust to adversarial perturbations.

Apps

Deep Network DesignerDesign, visualize, and train deep learning networks

Functions

trainingOptionsOptions for training deep learning neural network
trainNetworkTrain deep learning neural network

Topics

Set Up Parameters and Train Convolutional Neural Network

Learn how to set up training parameters for a convolutional neural network.

Deep Learning Using Bayesian Optimization

This example shows how to apply Bayesian optimization to deep learning and find optimal network hyperparameters and training options for convolutional neural networks.

Train Deep Learning Networks in Parallel

This example shows how to run multiple deep learning experiments on your local machine.

Train Network Using Custom Training Loop

This example shows how to train a network that classifies handwritten digits with a custom learning rate schedule.

Compare Activation Layers

This example shows how to compare the accuracy of training networks with ReLU, leaky ReLU, ELU, and swish activations layers.

Adapt Code Generated in Deep Network Designer for Use in Experiment Manager

Use Experiment Manager to tune the hyperparameters of a network trained in Deep Network Designer.

Deep Learning Tips and Tricks

Learn how to improve the accuracy of deep learning networks.

Train Robust Deep Learning Network with Jacobian Regularization

This example shows how to train a neural network that is robust to adversarial examples using a Jacobian regularization scheme [1].

Related Information

Featured Examples

Resume Training from Checkpoint Network

Resume Training from Checkpoint Network

Save checkpoint networks while training a deep learning network and resume training from a previously saved network.

Open Live Script
Generate Untargeted and Targeted Adversarial Examples for Image Classification

Generate Untargeted and Targeted Adversarial Examples for Image Classification

Use the fast gradient sign method (FGSM) and the basic iterative method (BIM) to generate adversarial examples for a pretrained neural network.

Open Live Script
Train Image Classification Network Robust to Adversarial Examples

Train Image Classification Network Robust to Adversarial Examples

Train a neural network that is robust to adversarial examples using fast gradient sign method (FGSM) adversarial training.

Open Live Script
Train Robust Deep Learning Network with Jacobian Regularization

Train Robust Deep Learning Network with Jacobian Regularization

Train a neural network that is robust to adversarial examples using a Jacobian regularization scheme [1].

Open Live Script

Deep Learning Toolbox Documentation

Support

Introducing Deep Learning with MATLAB

Introducing Deep Learning with MATLAB

Download ebook