how shall I read/write/add-write big data in MatLab?
Mostrar comentarios más antiguos
I set big data in variable X and Now I want to save it on my hard disk;
I use "save output X", and get warning: "out of memory";
I use "xlswrite('output.xlsx',X)", and get warnning: it is too big for this format;
Now how shall I write this big data and especially what if I want to add other data for other code into the "output" and how shall I read it out if it is too big?
Respuestas (2)
Walter Roberson
el 1 de En. de 2017
1 voto
If it is a numeric array, you could fwrite() it as a binary file.
For non-numeric items sometimes using memory mapping is appropriate.
You might be able to use the matFile interface to save part of it at a time.
Image Analyst
el 1 de En. de 2017
1 voto
One option is to split the workbook up into smaller workbooks, if there is anyway that makes sense, otherwise just arbitrarily at rows like 'firstHalf.xlsx' and 'secondHalf.xlsx'.
Categorías
Más información sobre Large Files and Big Data en Centro de ayuda y File Exchange.
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!