BackProgation Neural network on GPU

3 visualizaciones (últimos 30 días)
Tiki Tiki
Tiki Tiki el 3 de Ag. de 2018
Abierta de nuevo: Walter Roberson el 22 de Dic. de 2018
Hi everyone,
Can you help me how to write backprogation in neural network on GPU?
I assume that my data is big, and number of input, hidden, output neuron are 784, 1024 and 10. this like MNIST data.
I write code manually, not use function in neural network tools.
I wonder about update weight is not parallel, so How can use GPU here?
Thanks so much.
  2 comentarios
Joss Knight
Joss Knight el 3 de Ag. de 2018
Nobody is going to be able to answer your question in its current form. It's impossible to tell what help you need. If you don't know how to use the GPU in MATLAB, then read the documentation on that. If you don't know how to write the equations for backpropagation then you should be specific about what operation you want to backpropagate through. To get help, you need to be specific, and you need to provide some example code.
Tiki Tiki
Tiki Tiki el 6 de Ag. de 2018
Thank. I wrote backprogation code not use function 'train' support by matlab. So my mean is in the backprogation, we have to update weight based on previous weight. so I dont know how to use parallel programming here. is it mean we put 60000 samples of MNIST once time. and then caculate error?. please correct me if i am wrong? Thank.

Iniciar sesión para comentar.

Respuesta aceptada

Diwakar Ravichandran
Diwakar Ravichandran el 8 de Ag. de 2018
Hi Tiki,
As I try to understand you want to implement back propagation by hard coding the variables. To do the same you have to know the back propagation algorithm and understand how it works. You cant code on a GPU you code and the process runs on a GPU.
This article online explains what back propagation is as mentioned below,
Hope this helps,
Cheers!
  7 comentarios
Tiki Tiki
Tiki Tiki el 8 de Ag. de 2018
Thank. I already run code use function with GPU supported by matlab like train or feedforward. however, I cannot see inside function, So I had to write step by step to describe backprogation in my network. but i still dont understand how GPU can use.
Anyway, Thank for your support.

Iniciar sesión para comentar.

Más respuestas (0)

Categorías

Más información sobre Parallel and Cloud en Help Center y File Exchange.

Etiquetas

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by