Why is the learning rate for the bias usually twice as large as the the LR for the weights?

Why is the learning rate for the bias usually twice as large as the the LR for the weights?

2 comentarios

Please post the proof of this assertion.
Greg
on the other hand if you check, for example alexnet layers you will find that net.Layers(N, 1).BiasLearnRateFactor=2 and net.Layers(N, 1).WeightLearnRateFactor = 1

Iniciar sesión para comentar.

Respuestas (0)

Categorías

Más información sobre Deep Learning Toolbox en Centro de ayuda y File Exchange.

Preguntada:

el 3 de En. de 2018

Editada:

el 5 de En. de 2018

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by