Can we say that overfitting occur in this plot?
4 visualizaciones (últimos 30 días)
Mostrar comentarios más antiguos
Performance plot from ANN is obtained as shown below.Does overfitting happen here?
![](https://www.mathworks.com/matlabcentral/answers/uploaded_files/194233/image.png)
0 comentarios
Respuestas (1)
Greg Heath
el 23 de Ag. de 2018
This is a case of
*OVERTRAINING AN OVERFIT NET*
There are at least 3 ways to avoid this:
1. *DO NOT OVERFIT:*
Make sure that the number of unknown weights, Nw does not
exceed the number of training equations, Ntrneq.
2. *DO NOT OVERTRAIN*
In particular, the problem is not necessarily the
overfitting. Overfitting is easily mitigated by NOT
OVERTRAINING
a. Use a VALIDATION set to implement "EARLY STOPPING".
b. Use "REGULARIZATION" via TRAINBR to implement
"BAYESIAN RREGULARIZATION"
See
https://www.mathworks.com/matlabcentral/answers/280818-how-to-solve-overtrained-nn-with-validation-stop
Hope this helps.
Thank you for formally accepting my answer
Greg
4 comentarios
KAE
el 5 de Sept. de 2018
Editada: KAE
el 5 de Sept. de 2018
And in the first plot (original question), the val error rate only increases for 5 continuous epochs, during epoch 6-11, while the training error is decreasing. Since 5 is less than the default of 6, the first plot shows overtraining. Is this interpretation right?
Ver también
Categorías
Más información sobre Sequence and Numeric Feature Data Workflows en Help Center y File Exchange.
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!