Both sides previous revision
Previous revision
Next revision
|
Previous revision
Next revision
Both sides next revision
|
slurm [2022/09/27 13:54] vodrazka [Batch mode] |
slurm [2022/10/17 10:35] fucik [Interactive mode] |
</code> | </code> |
| |
| === CPU core allocation === |
| |
| The minimal computing resource in SLURM is one CPU core. However, CPU count advertised by SLURM corresponds to the number of CPU threads. |
| If you ask for 1 CPU core with <code>--cpus-per-task=1</code> SLURM will allocate all threads of 1 CPU core. |
| |
| For example ''dll-8gpu1'' will allocate 2 threads since its ThreadsPerCore=2: |
| |
| <code> |
| $> scontrol show node dll-8gpu1 |
| $ scontrol show node dll-8gpu1 |
| NodeName=dll-8gpu1 Arch=x86_64 CoresPerSocket=16 |
| CPUAlloc=0 CPUTot=64 CPULoad=0.05 // CPUAlloc - allocated threads, CPUTot - total threads |
| AvailableFeatures=gpuram24G |
| ActiveFeatures=gpuram24G |
| Gres=gpu:nvidia_a30:8(S:0-1) |
| NodeAddr=10.10.24.63 NodeHostName=dll-8gpu1 Version=21.08.8-2 |
| OS=Linux 5.15.35-1-pve #1 SMP PVE 5.15.35-3 (Wed, 11 May 2022 07:57:51 +0200) |
| RealMemory=515838 AllocMem=0 FreeMem=507650 Sockets=2 Boards=1 |
| CoreSpecCount=1 CPUSpecList=62-63 // CoreSpecCount - cores reserved for OS, CPUSpecList - list of threads reserved for system |
| State=IDLE ThreadsPerCore=2 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A // ThreadsPerCore - count of threads for 1 CPU core |
| Partitions=gpu-ms |
| BootTime=2022-09-01T14:07:50 SlurmdStartTime=2022-09-02T13:54:05 |
| LastBusyTime=2022-10-02T20:17:09 |
| CfgTRES=cpu=64,mem=515838M,billing=64 |
| AllocTRES= |
| CapWatts=n/a |
| CurrentWatts=0 AveWatts=0 |
| ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s |
| </code> |
| |
| In the example above you can see comments at all lines relevant to CPU allocation. |
| |
| |
* ''--gres=gpu:2'' requires 2 GPUs | * ''--gres=gpu:2'' requires 2 GPUs |
| |
<code>srun -p gpu-troja --constraint="gpuram44G|gpuram39G" --mem=64G --gres=gpu:2 --pty bash</code> | <code>srun -p gpu-troja --constraint="gpuram48G|gpuram40G" --mem=64G --gres=gpu:2 --pty bash</code> |
* ''--constraint="gpuram44G|gpuram39G"'' only consider nodes that have either ''gpuram44G'' or ''gpuram39G'' feature defined | * ''--constraint="gpuram48G|gpuram40G"'' only consider nodes that have either ''gpuram48G'' or ''gpuram40G'' feature defined |
| |
To see all the available options type: | To see all the available options type: |