Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
slurm [2022/09/06 15:50] vodrazka [Cluster info] |
slurm [2022/10/25 14:20] vodrazka [cpu-ms] |
||
---|---|---|---|
Line 1: | Line 1: | ||
====== ÚFAL Grid Engine (LRC) ====== | ====== ÚFAL Grid Engine (LRC) ====== | ||
- | LRC (Linguistic Research Cluster) is a name of ÚFAL' | + | LRC (Linguistic Research Cluster) is the name of ÚFAL' |
+ | Currently there are following partitions (queues) available for computing: | ||
+ | |||
+ | ===== Node list by partitions ===== | ||
+ | |||
+ | ==== cpu-troja ==== | ||
+ | |||
+ | | Node name | Thread count | Socket: | ||
+ | | achilles1 | 32 | 2:8:2 | 128810 | | ||
+ | | achilles2 | 32 | 2:8:2 | 128810 | | ||
+ | | achilles3 | 32 | 2:8:2 | 128810 | | ||
+ | | achilles4 | 32 | 2:8:2 | 128810 | | ||
+ | | achilles5 | 32 | 2:8:2 | 128810 | | ||
+ | | achilles6 | 32 | 2:8:2 | 128810 | | ||
+ | | achilles7 | 32 | 2:8:2 | 128810 | | ||
+ | | achilles8 | 32 | 2:8:2 | 128810 | | ||
+ | | hector1 | 32 | 2:8:2 | 128810 | | ||
+ | | hector2 | 32 | 2:8:2 | 128810 | | ||
+ | | hector3 | 32 | 2:8:2 | 128810 | | ||
+ | | hector4 | 32 | 2:8:2 | 128810 | | ||
+ | | hector5 | 32 | 2:8:2 | 128810 | | ||
+ | | hector6 | 32 | 2:8:2 | 128810 | | ||
+ | | hector7 | 32 | 2:8:2 | 128810 | | ||
+ | | hector8 | 32 | 2:8:2 | 128810 | | ||
+ | | helena1 | 32 | 2:8:2 | 128811 | | ||
+ | | helena2 | 32 | 2:8:2 | 128811 | | ||
+ | | helena3 | 32 | 2:8:2 | 128811 | | ||
+ | | helena4 | 32 | 2:8:2 | 128811 | | ||
+ | | helena5 | 32 | 2:8:2 | 128810 | | ||
+ | | helena6 | 32 | 2:8:2 | 128811 | | ||
+ | | helena7 | 32 | 2:8:2 | 128810 | | ||
+ | | helena8 | 32 | 2:8:2 | 128811 | | ||
+ | | paris1 | 32 | 2:8:2 | 128810 | | ||
+ | | paris2 | 32 | 2:8:2 | 128810 | | ||
+ | | paris3 | 32 | 2:8:2 | 128810 | | ||
+ | | paris4 | 32 | 2:8:2 | 128810 | | ||
+ | | paris5 | 32 | 2:8:2 | 128810 | | ||
+ | | paris6 | 32 | 2:8:2 | 128810 | | ||
+ | | paris7 | 32 | 2:8:2 | 128810 | | ||
+ | | paris8 | 32 | 2:8:2 | 128810 | | ||
+ | | hyperion2 | 64 | 2:16:2 | 257667 | | ||
+ | | hyperion3 | 64 | 2:16:2 | 257667 | | ||
+ | | hyperion4 | 64 | 2:16:2 | 257667 | | ||
+ | | hyperion5 | 64 | 2:16:2 | 257667 | | ||
+ | | hyperion6 | 64 | 2:16:2 | 257667 | | ||
+ | | hyperion7 | 64 | 2:16:2 | 257667 | | ||
+ | | hyperion8 | 64 | 2:16:2 | 257667 | | ||
+ | ==== cpu-ms ==== | ||
+ | |||
+ | | Node name | Thread count | Socket: | ||
+ | | iridium | 16 | 2:4:2 | 515977 | | ||
+ | | orion1 | 40 | 2:10:2 | 128799 | | ||
+ | | orion2 | 40 | 2:10:2 | 128799 | | ||
+ | | orion3 | 40 | 2:10:2 | 128799 | | ||
+ | | orion4 | 40 | 2:10:2 | 128799 | | ||
+ | | orion5 | 40 | 2:10:2 | 128799 | | ||
+ | | orion6 | 40 | 2:10:2 | 128799 | | ||
+ | | orion7 | 40 | 2:10:2 | 128799 | | ||
+ | | orion8 | 40 | 2:10:2 | 128799 | | ||
+ | ==== gpu-troja ==== | ||
+ | |||
+ | ==== gpu-ms ==== | ||
+ | |||
+ | In order to submit a job you need to login to one of the head nodes: | ||
+ | |||
+ | | ||
+ | | ||
===== Basic usage ===== | ===== Basic usage ===== | ||
Line 17: | Line 83: | ||
#!/bin/bash | #!/bin/bash | ||
#SBATCH -J helloWorld | #SBATCH -J helloWorld | ||
- | #SBATCH -p cpu-troja | + | #SBATCH -p cpu-troja |
#SBATCH -o helloWorld.out | #SBATCH -o helloWorld.out | ||
#SBATCH -e helloWorld.err | #SBATCH -e helloWorld.err | ||
Line 33: | Line 99: | ||
#SBATCH -N 2 # number of nodes (default 1) | #SBATCH -N 2 # number of nodes (default 1) | ||
#SBATCH --nodelist=node1, | #SBATCH --nodelist=node1, | ||
- | #SBATCH -c 4 # number of cores/ | + | #SBATCH --cpus-per-task=4 |
#SBATCH --gres=gpu: | #SBATCH --gres=gpu: | ||
#SBATCH --mem=10G | #SBATCH --mem=10G | ||
+ | </ | ||
+ | |||
+ | If you need you can have slurm report to you: | ||
+ | |||
+ | < | ||
+ | #SBATCH --mail-type=begin | ||
+ | #SBATCH --mail-type=end | ||
+ | #SBATCH --mail-type=fail | ||
+ | #SBATCH --mail-user=< | ||
</ | </ | ||
Line 81: | Line 156: | ||
< | < | ||
sinfo | sinfo | ||
+ | </ | ||
+ | |||
+ | List detailed info about nodes: | ||
+ | < | ||
+ | sinfo -l -N | ||
</ | </ | ||
- | List types of available GPUs: | + | List nodes with some custom format info: |
< | < | ||
- | sinfo -o %G | + | sinfo -N -o "%N %P %.11T %.15f" |
</ | </ | ||
+ | === CPU core allocation === | ||
+ | |||
+ | The minimal computing resource in SLURM is one CPU core. However, CPU count advertised by SLURM corresponds to the number of CPU threads. | ||
+ | If you ask for 1 CPU core with < | ||
+ | |||
+ | For example '' | ||
+ | |||
+ | < | ||
+ | $> scontrol show node dll-8gpu1 | ||
+ | $ scontrol show node dll-8gpu1 | ||
+ | NodeName=dll-8gpu1 Arch=x86_64 CoresPerSocket=16 | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | </ | ||
+ | In the example above you can see comments at all lines relevant to CPU allocation. | ||
Line 102: | Line 212: | ||
There are many more parameters available to use. For example: | There are many more parameters available to use. For example: | ||
- | < | + | **To get an interactive CPU job with 64GB of reserved memory:** |
+ | < | ||
- | Where: | + | |
- | | + | |
* '' | * '' | ||
+ | |||
+ | **To get interactive job with a single GPU of any kind:** | ||
+ | < | ||
+ | * '' | ||
+ | * '' | ||
+ | |||
+ | < | ||
+ | * '' | ||
+ | * '' | ||
+ | * '' | ||
+ | |||
+ | < | ||
+ | * '' | ||
To see all the available options type: | To see all the available options type: | ||
< | < | ||
+ | |||
+ | ===== See also ===== | ||
+ | |||
+ | https:// | ||
+ | |||