resource-monitor

Memory reported in Resource Monitor not showing in UMDH

人走茶凉 提交于 2019-12-11 05:09:43
问题 I have a service which intermittently starts gobbling up server memory over time and needs to be restarted to free it. I turned +ust with gflags, restarted the service, and started taking scheduled UMDH snapshots. When the problem reoccurred, resource manager reported multiple GB under Working set and Private bytes, but the UMDH snapshots account only for a few MB allocations in the process' heaps. At the top of UMDH snapshot files, it mentions "Only allocations for which the heap manager

Which API does Windows Resource Monitor use?

别来无恙 提交于 2019-12-09 00:57:13
问题 Windows Resource Monitor displays (among other things) which files on disk are currently accessed by which processes. And it does that in realtime. How? I know that it probably uses ETW and that I can generate traces with tools like xperf. But how to get realtime information without having to start, stop and parse a trace file? I need to programmatically access the data, i.e. from C# or C++. 回答1: wOpenTrace/ProcessTrace/StopTrace can get the data in real-time as long as you know the provider

How to monitor resources during slurm job?

南笙酒味 提交于 2019-12-05 01:31:45
问题 I'm running jobs on our university cluster (regular user, no admin rights), which uses the SLURM scheduling system and I'm interested in plotting the CPU and memory usage over time, i.e while the job is running. I know about sacct and sstat and I was thinking to include these commands in my submission script, e.g. something in the line of #!/bin/bash #SBATCH <options> # Running the actual job in background srun my_program input.in output.out & # While loop that records resources JobStatus="$

How to monitor resources during slurm job?

喜欢而已 提交于 2019-12-03 15:46:35
I'm running jobs on our university cluster (regular user, no admin rights), which uses the SLURM scheduling system and I'm interested in plotting the CPU and memory usage over time, i.e while the job is running. I know about sacct and sstat and I was thinking to include these commands in my submission script, e.g. something in the line of #!/bin/bash #SBATCH <options> # Running the actual job in background srun my_program input.in output.out & # While loop that records resources JobStatus="$(sacct -j $SLURM_JOB_ID | awk 'FNR == 3 {print $6}')" FIRST=0 #sleep time in seconds STIME=15 while [ "

top command for GPU's using CUDA

独自空忆成欢 提交于 2019-11-29 18:44:28
I'm trying to monitor a process that uses cuda and MPI, is there any way I could do this, something like the command "top" but that monitors the GPU too? I find gpustat very useful. In can be installed with pip install gpustat , and prints breakdown of usage by processes or users. To get real-time insight on used resources, do: nvidia-smi -l 1 This will loop and call the view at every second. If you do not want to keep past traces of the looped call in the console history, you can also do: watch -n0.1 nvidia-smi Where 0.1 is the time interval, in seconds. I'm not aware of anything that

top command for GPU's using CUDA

99封情书 提交于 2019-11-28 13:27:52
问题 I'm trying to monitor a process that uses cuda and MPI, is there any way I could do this, something like the command "top" but that monitors the GPU too? 回答1: I find gpustat very useful. In can be installed with pip install gpustat , and prints breakdown of usage by processes or users. 回答2: To get real-time insight on used resources, do: nvidia-smi -l 1 This will loop and call the view at every second. If you do not want to keep past traces of the looped call in the console history, you can