torque

PBS, refresh stdout

∥☆過路亽.° 提交于 2019-11-30 18:44:41
I have a long running Torque/PBS job and I'd like to monitor output. But log file only gets copied after the job is finished. Is there a way to convince PBS to refresh it? Unfortunately, AFAIK, that is not possible with PBS/Torque - the stdout/stderr streams are locally spooled on the execution host and then transferred to the submit host after the job has finished. You can redirect the standard output of the program to a file if you'd like to monitor it during the execution (it makes sense only if the execution and the sumit hosts share a common filesystem). I suspect the rationale is that it

How to set up doSNOW and SOCK cluster with Torque/MOAB scheduler?

不羁的心 提交于 2019-11-30 16:06:25
问题 In continuation of this question (https://stackoverflow.com/questions/17222942/allow-foreach-workers-to-register-and-distribute-sub-tasks-to-other-workers), what is a best practice to connect doSNOW and SOCK cluster to Torque/MOAB scheduler in order to avoid processor affinity in an inner parallel loop that handles some part of the code of an outer parallel loop? From the Steve's answer to that question, the baseline code without intraction with the scheduler could be: library(doSNOW) hosts <

PBS, refresh stdout

亡梦爱人 提交于 2019-11-30 03:13:57
问题 I have a long running Torque/PBS job and I'd like to monitor output. But log file only gets copied after the job is finished. Is there a way to convince PBS to refresh it? 回答1: Unfortunately, AFAIK, that is not possible with PBS/Torque - the stdout/stderr streams are locally spooled on the execution host and then transferred to the submit host after the job has finished. You can redirect the standard output of the program to a file if you'd like to monitor it during the execution (it makes