Best GPU for Deep Learning Training

Which GPU among GeForce RTX3090, RTX A6000, or A100 do you think is the best for deep learning using Matlab?

Not in inference, but in Training

This is GPU's Spec

https://en.wikipedia.org/wiki/List_of_Nvidia_graphics_processing_units

Answer 1

[Abhijit Bhattacharjee]

A very good (and up-to-date) reference article on this topic can be found here: Tim Dettmers Which GPU for Deep Learning.

Because MATLAB's Deep Learning Toolbox uses CUDA and CUDNN libraries just like almost every other deep learning framework, the recommendations in the article above should mostly apply for MATLAB as well.

Please note that the opinions and statements in the article belong to the author and are not formally endorsed by MathWorks.