Load data one file at time for CNN training
8 views (last 30 days)
Show older comments
Sunny on 8 Jan 2019
Answered: Vishal Bhutani on 11 Jan 2019
I have dataset with 4700 images with dimensions 2000*102. All these images are converted to seperate CSV files (pixel values). I think I can't load all these csv files at a time as this will crash my RAM (32GB) when the network starts to train. Is it possible in Matlab to access each image(.csv) file during training and testing from storage location rather than placing it on RAM. This is to train and test CNN in deep learning extension.
Vishal Bhutani on 11 Jan 2019
Try the solutions mentioned in the link attached below. It contains solution how to access data from CSV file directly when size of CSV file is large.
Hope it helps.
Find more on Recognition, Object Detection, and Semantic Segmentation in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!Start Hunting!