How to organize a datastore with multiple devices for multiple days?
2 visualizaciones (últimos 30 días)
Mostrar comentarios más antiguos
Magsud Hasanov
el 22 de Mayo de 2022
Respondida: Magsud Hasanov
el 14 de Jun. de 2022
So, I have a data from 75 smart meters for range of 17 days.
Each day all 75 smart meters did some measurements.
How it is better to organize the data? I really like the idea of datastore() in Matlab. But don't know how to do it automatically for so many variables(tables)
If I create a timetable for each day of each smart meter, it would require me to create 75*17 =1275 separate tables.
And also I would like to analyze each day (with all smart meter measurements combined) so it will make the total number 1275 +17 = 1292.
Can you suggest a good option of organizing such big amount of data?
I am analyzing it for load forecasting using Machine Learning.
Thank you very much in advance!
1 comentario
dpb
el 22 de Mayo de 2022
That's really not much data at all in terms of observations -- unless there are gigabytes of data which it wouldn't seem there could be but a few measurements from each device.
I'd just collect the whole dataset in memory in a timetable and use retime and similar functions to do operations over the data. memapfile is just going to get in the way here.
Respuesta aceptada
Más respuestas (1)
Seth Furman
el 30 de Mayo de 2022
Provided your data are already stored in files on disk in a common format, you can create a tall timetable and perform operations on it as if it were a large timetable.
Ver también
Categorías
Más información sobre Large Files and Big Data en Help Center y File Exchange.
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!