How can I implement MATLAB parallel computing on more than one node

Hi everyone! I have a problem in implementing MATLAB parallel computing.

On a supercomputing server, I assign the task to 2 nodes (48 workers in maximum).

But the MATLAB command 'parpool(36)' cannot work. The error message is shown in the picture below.

I feel so confused about it and havn't found a solution to it in the community.

I really appreciate it if anyone can help me! Thank you so much!

Answer 1

[lomula satewilo]

As the error message shows, the cluster "local" only allows for a maximum of 24 workers (equal to the number of physical cores on the local node). To recruit workers on more than one node, another cluster must be defined and used:

c = parcluster('My_cluster_profile');

p = parpool(c, 36);

Use Cluster Profile Manager in Matlab to discover or create cluster profiles. For running jobs on multiple nodes, Matlab Parallel Server has to be installed too, in addition to Parallel Toolbox. Otherwise, you can only run parallel jobs on the local machine.

[Shuaibin WAN]

Thank you so much for your help!

Yes, you are right. Usually, MATLAB only use local workers.

Later I found local workers were kind of enough for my research, although I had to spend more days to wait for my results lol.

Answer 2

[Aya Ghalayini]

I had the same problem and I was told by my administrator that Matlab seems to use only one node. See this link as well: https://stackoverflow.com/questions/17978421/matlab-parallel-processing-on-several-nodes

I hope this helps.