Can you help me how to write backprogation in neural network on GPU?
I assume that my data is big, and number of input, hidden, output neuron are 784, 1024 and 10. this like MNIST data.
I write code manually, not use function in neural network tools.
I wonder about update weight is not parallel, so How can use GPU here?
Thanks so much.