Reading large .csv data with 12 million rows

68 visualizaciones (últimos 30 días)
Ganesh Naik
Ganesh Naik el 10 de Nov. de 2021
Comentada: Mathieu NOE el 16 de Dic. de 2021
Hi all, I have .CSV file with 14 columns and around 12 million rows. I would like to read the data and use it for further analysis. When I use "readtable" command it reads only first two columns with all the information but fails to read other column data. Is there anyway I can read the entire dataset once?
Thanks in advance.
  3 comentarios
Mathieu NOE
Mathieu NOE el 16 de Dic. de 2021
ok glad you havefound a workaround ! :)

Iniciar sesión para comentar.

Respuestas (1)

Sivani Pentapati
Sivani Pentapati el 1 de Dic. de 2021
Hi Ganesh,
You can try using readmatrix in place of readtable. Other workaround is to convert the 'csv' files into 'mat' files and save them with '-v7.3' option. Please refer to this answer for more information.
  1 comentario
Ganesh Naik
Ganesh Naik el 16 de Dic. de 2021
Dear Sivani, I have solved the problem using SplitCSV method, reading each file and combining the data (I have explained my method above). It worked for me.

Iniciar sesión para comentar.


Más información sobre Large Files and Big Data en Help Center y File Exchange.


Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by