Load data one file at time for CNN training

5 visualizaciones (últimos 30 días)
Sunny
Sunny el 8 de En. de 2019
Respondida: Vishal Bhutani el 11 de En. de 2019
I have dataset with 4700 images with dimensions 2000*102. All these images are converted to seperate CSV files (pixel values). I think I can't load all these csv files at a time as this will crash my RAM (32GB) when the network starts to train. Is it possible in Matlab to access each image(.csv) file during training and testing from storage location rather than placing it on RAM. This is to train and test CNN in deep learning extension.

Respuestas (1)

Vishal Bhutani
Vishal Bhutani el 11 de En. de 2019
Try the solutions mentioned in the link attached below. It contains solution how to access data from CSV file directly when size of CSV file is large.
Hope it helps.

Categorías

Más información sobre Image Data Workflows en Help Center y File Exchange.

Etiquetas

Productos


Versión

R2018b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by