Because MDS crashes, there was a fix to check for an MDS crash and go on to the next shot. When this happens, it relaunches but uses the default slurm directory option in submit_single_run() in launch_parallel_jobs_function.py. This is currently not updated based on the slurm directory when you run the launch_parallel_jobs.py script.
Because of this bug, it ends up crashing when MDS fails because this slurm directory doesn't exist.
Because MDS crashes, there was a fix to check for an MDS crash and go on to the next shot. When this happens, it relaunches but uses the default slurm directory option in
submit_single_run()inlaunch_parallel_jobs_function.py. This is currently not updated based on the slurm directory when you run thelaunch_parallel_jobs.pyscript.Because of this bug, it ends up crashing when MDS fails because this slurm directory doesn't exist.