Discussion:
[torqueusers] pbs_mom disk space check
Dr. Henrik Schulz
2017-10-13 06:39:30 UTC
Permalink
Dear all,

we are using torque-4.2.7 and I observed a problem with the '-l file‘ option in qsub in combination with the ‚size [=/scratch]‘ option in mom_priv/config.

Whenever a job requests more than 32TB, the job does not start. Of course the disk space in our /scratch is large enough (270TB currently).

Is there a limit for the disk space check? And why is it in the range of 2^35?

Any hints?

Thanks!
Henrik

--
Dr. Henrik Schulz
Leiter Abteilung IT-Infrastruktur
Zentralabteilung Informationsdienste und Computing
Helmholtz-Zentrum Dresden-Rossendorf
Tel: +49 (0351) 260 3268
***@hzdr.de <mailto:***@hzdr.de>
http://www.hzdr.de/fwci <http://www.hzdr.de/fwci>
Vorstand: Prof. Dr. Dr. h. c. Roland Sauerbrey, Prof. Dr. Dr. h. c. Peter Joehnk
Vereinsregister: VR 1693 beim Amtsgericht Dresden
Dr. Henrik Schulz
2017-10-17 05:56:16 UTC
Permalink
Dear all,

it seems that the answer to the question is easier than I thought. The idea behind the ‚-l file‘ option in qsub seems to mean that each single process gets a reservation of the local disk space requested. In our case the job didn®t start, because we used ‚ppn=8‘ and ‚-l file=35500gb‘. The /scratch dir had a free space of 270TB and therefore the behavior was correct.

Best regards,
Henrik
Post by Dr. Henrik Schulz
Dear all,
we are using torque-4.2.7 and I observed a problem with the '-l file‘ option in qsub in combination with the ‚size [=/scratch]‘ option in mom_priv/config.
Whenever a job requests more than 32TB, the job does not start. Of course the disk space in our /scratch is large enough (270TB currently).
Is there a limit for the disk space check? And why is it in the range of 2^35?
Any hints?
Thanks!
Henrik
--
Dr. Henrik Schulz
Leiter Abteilung IT-Infrastruktur
Zentralabteilung Informationsdienste und Computing
Helmholtz-Zentrum Dresden-Rossendorf
Tel: +49 (0351) 260 3268
http://www.hzdr.de/fwci <http://www.hzdr.de/fwci>
Vorstand: Prof. Dr. Dr. h. c. Roland Sauerbrey, Prof. Dr. Dr. h. c. Peter Joehnk
Vereinsregister: VR 1693 beim Amtsgericht Dresden
_______________________________________________
torquedev mailing list
http://www.supercluster.org/mailman/listinfo/torquedev
Loading...