Exceeding maximum array size with mldivide and sparse matrices?

3 visualizaciones (últimos 30 días)
Dan Gianotti
Dan Gianotti el 8 de Mzo. de 2017
Comentada: Dan Gianotti el 14 de Mzo. de 2017
I have two (large) sparse matrices:
size(A) = [6262144 6262144]
size(B) = [6262144 864000]
I would like to calculate A \ B (and get a sparse matrix result), but get an error about exceeding maximum array size:
Requested 6262144x864000 (40311.3GB) array exceeds maximum array size preference. Creation of arrays greater than this limit may take a long time and cause MATLAB to become unresponsive. See array size limit or preference panel for more information.
Obviously this is a little silly since the array being created is the same size as B (which happily exists with no problem). I'm presuming that mldivide is converting some intermediate matrix to full along the way, understandably causing memory problems.
Is there a work-around for this?

Respuestas (1)

Xiangbo Liang
Xiangbo Liang el 14 de Mzo. de 2017
I believe you can use MATLAB tall array instead to deal with the arrays that is too large and possibly exceed the memory limit.
For most of the operations, tall array works very similarly as the traditional arrays, you can find the detailed instructions on the documentation page below:
  1 comentario
Dan Gianotti
Dan Gianotti el 14 de Mzo. de 2017
I'll try this, but it sounds like it won't make use of the MUCH more efficient methods used for matrix division when using sparse matrices (which seems important given the size of these matrices).
Is that right?

Iniciar sesión para comentar.

Categorías

Más información sobre Matrix Indexing en Help Center y File Exchange.

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by