I am running a script which uses the 'trainlm' neural net training algorithm multiple times. It time that it runs it stops when it has not improved for 7 epochs. It then, it seems, provides the model for that last epoch (epoch 'n'), not the best fitting model from epoch n-7, which often is substantially better. Is this correct and is there any way to get the model from the best fitting epoch?

 Respuesta aceptada

Greg Heath
Greg Heath el 2 de Jun. de 2018
Editada: Greg Heath el 2 de Jun. de 2018

0 votos

Early stopping ONLY depends on the 15% validation subset performance. NOT on the 70% training or 15% testing performance.
Increasing val set error is proof that the net is not generalizing well to nontraining data.
Since the decreasing improvement neither refers to the 70% training or 15% testing subset, there is no proof that there is a need to back up.
Hope this helps.
Thank you for formally accepting my answer
Greg

1 comentario

Walter Johnson
Walter Johnson el 3 de Jun. de 2018
Thanks Greg. That is clear and should have been obvious.

Iniciar sesión para comentar.

Más respuestas (0)

Categorías

Más información sobre Sequence and Numeric Feature Data Workflows en Centro de ayuda y File Exchange.

Productos

Versión

R2018a

Etiquetas

Preguntada:

el 2 de Jun. de 2018

Comentada:

el 3 de Jun. de 2018

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by