Cluster Profile Manager SPMD job test Failed

MATLAB 9.6.0.1214997 (R2019a) Update 6

I could not use parfor so I tried to Validate my cluster in Cluster Profile Manager.

Cluster Connection test and job test passed, but SPMD job test failed with the following report: attached file.

I tried doing the following

distcomp.feature( 'LocalUseMpiexec', false )

but it was of no avail.

I also tried the following: MATLAB parloop error solution but it doesn't work either.

Answer 1

[Edric Ellis]

I'm going to guess you're using Linux. This is probably related to your ulimit settings, probably the limit on number of processes. Check

$ ulimit -u

or

$ ulimit -a

to report all limits.

[Soumak Bhattacharjee]

Yes, I am. The output is as follows:

$ ulimit -u
1024

$ ulimit -a

core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 2067606
max locked memory       (kbytes, -l) unlimited
max memory size         (kbytes, -m) unlimited
open files                      (-n) 4096
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) unlimited
cpu time               (seconds, -t) unlimited
max user processes              (-u) 1024
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited

PS: The problem persists.

Stage: SPMD job test (createCommunicatingJob)
Status: Failed

[Edric Ellis]

Try:

$ ulimit -u 63536

[Soumak Bhattacharjee]

Nope. This the problem still persists.

Stage: SPMD job test (createCommunicatingJob)
Status: Failed
Start Time: Mon Dec 23 07:06:46 IST 2019
Finish Time: Mon Dec 23 07:06:59 IST 2019
Running Duration: 0 min 13 sec
Description: Job errored or did not reach the state 'finished'.
Error Report: Job errored or did not reach the state 'finished'.
Command Line Output: 
Debug Log: LOG FILE OUTPUT:
 [7]thread_monitor Resource temporarily unavailable in pthread_create
 [7]thread_monitor Resource temporarily unavailable in pthread_create
 [7]thread_monitor Resource temporarily unavailable in pthread_create
 [7]thread_monitor Resource temporarily unavailable in pthread_create
 [7]thread_monitor Resource temporarily unavailable in pthread_create
 [7]thread_monitor Resource temporarily unavailable in pthread_create
 [7]thread_monitor Resource temporarily unavailable in pthread_create
 [7]thread_monitor Resource temporarily unavailable in pthread_create
 [7]thread_monitor Resource temporarily unavailable in pthread_create
 [7]thread_monitor Resource temporarily unavailable in pthread_create
 [7]thread_monitor Resource temporarily unavailable in pthread_create
 [7]thread_monitor Resource temporarily unavailable in pthread_create
 [7]thread_monitor Resource temporarily unavailable in pthread_create
 [26]thread_monitor Resource temporarily unavailable in pthread_create
 [31]thread_monitor Resource temporarily unavailable in pthread_create

[Annette Greiner]

I have the same problem in a new installation of R2020b.

[Annette Greiner]

agreiner@nid00021>ulimit -a

core file size (blocks, -c) 0

data seg size (kbytes, -d) unlimited

scheduling priority (-e) 0

file size (blocks, -f) unlimited

pending signals (-i) 513040

max locked memory (kbytes, -l) unlimited

max memory size (kbytes, -m) 123731968

open files (-n) 4096

pipe size (512 bytes, -p) 8

POSIX message queues (bytes, -q) 819200

real-time priority (-r) 0

stack size (kbytes, -s) unlimited

cpu time (seconds, -t) unlimited

max user processes (-u) 2048

virtual memory (kbytes, -v) unlimited

file locks (-x) unlimited