How to handle big csv files
7 visualizaciones (últimos 30 días)
Mostrar comentarios más antiguos
I have huge .csv files comming daily and i want to know how i can handle them. For the moment, only to have an idea, i run a python script first in order to decrease the size by averaging the file. Is splitting the big file the only option i have?
P.S. one line of my file looks like:
00:00:0;0.0;0.00540500736377
0 comentarios
Respuestas (1)
Walter Roberson
el 1 de Sept. de 2018
Another approach is to fopen() the file, and textscan() using a repeat count (a number as the parameter after the format string) to control how many lines are read at a time; you would read a chunk, process it, go back to read another chunk, and so on.
0 comentarios
Ver también
Categorías
Más información sobre Standard File Formats en Help Center y File Exchange.
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!