Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
slurm [2022/08/31 11:08] vodrazka [Basic usage] |
slurm [2022/10/17 11:41] fucik [Interactive mode] |
||
---|---|---|---|
Line 1: | Line 1: | ||
====== ÚFAL Grid Engine (LRC) ====== | ====== ÚFAL Grid Engine (LRC) ====== | ||
- | LRC (Linguistic Research Cluster) is a name of ÚFAL' | + | LRC (Linguistic Research Cluster) is the name of ÚFAL' |
+ | Currently there are following partitions (queues) available for computing: | ||
+ | |||
+ | | **Partition name** | **Nodes** | ||
+ | | cpu-troja | ||
+ | | gpu-troja | ||
+ | | gpu-ms | ||
+ | |||
+ | In order to submit a job you need to login to one of the head nodes: | ||
+ | |||
+ | | ||
+ | | ||
===== Basic usage ===== | ===== Basic usage ===== | ||
+ | |||
+ | ==== Batch mode ==== | ||
+ | |||
+ | The core idea is that you write a batch script containing the commands you wish to run as well as a list of '' | ||
+ | Then the script is submitted to the cluster with: | ||
+ | |||
+ | < | ||
+ | |||
+ | Here is a simple working example: | ||
+ | |||
+ | < | ||
+ | #!/bin/bash | ||
+ | #SBATCH -J helloWorld | ||
+ | #SBATCH -p cpu-troja | ||
+ | #SBATCH -o helloWorld.out | ||
+ | #SBATCH -e helloWorld.err | ||
+ | |||
+ | # run my job (some executable) | ||
+ | sleep 5 | ||
+ | echo "Hello I am running on cluster!" | ||
+ | </ | ||
+ | |||
+ | After submitting this simple code you should end up with the two files ('' | ||
+ | |||
+ | Here is the list of other useful '' | ||
+ | < | ||
+ | #SBATCH -D / | ||
+ | #SBATCH -N 2 # number of nodes (default 1) | ||
+ | #SBATCH --nodelist=node1, | ||
+ | #SBATCH --cpus-per-task=4 | ||
+ | #SBATCH --gres=gpu: | ||
+ | #SBATCH --mem=10G | ||
+ | </ | ||
+ | |||
+ | If you need you can have slurm report to you: | ||
+ | |||
+ | < | ||
+ | #SBATCH --mail-type=begin | ||
+ | #SBATCH --mail-type=end | ||
+ | #SBATCH --mail-type=fail | ||
+ | #SBATCH --mail-user=< | ||
+ | </ | ||
+ | |||
+ | As usuall the complete set of options can be found by typing: | ||
+ | |||
+ | < | ||
+ | man sbatch | ||
+ | </ | ||
+ | |||
+ | ==== Running jobs ==== | ||
+ | |||
+ | In order to inspect all running jobs on the cluster use: | ||
+ | |||
+ | < | ||
+ | squeue | ||
+ | </ | ||
+ | |||
+ | filter only jobs of user '' | ||
+ | |||
+ | < | ||
+ | squeue -u linguist | ||
+ | </ | ||
+ | |||
+ | filter only jobs on partition '' | ||
+ | |||
+ | < | ||
+ | squeue -p gpu-ms | ||
+ | </ | ||
+ | |||
+ | filter jobs in specific state (see '' | ||
+ | < | ||
+ | squeue -t RUNNING | ||
+ | </ | ||
+ | |||
+ | filter jobs running on a specific node: | ||
+ | < | ||
+ | squeue -w dll-3gpu1 | ||
+ | </ | ||
+ | |||
+ | ==== Cluster info ==== | ||
+ | |||
+ | The command '' | ||
+ | |||
+ | List available partitions(queues). The default partition is marked with '' | ||
+ | < | ||
+ | sinfo | ||
+ | </ | ||
+ | |||
+ | List detailed info about nodes: | ||
+ | < | ||
+ | sinfo -l -N | ||
+ | </ | ||
+ | |||
+ | List nodes with some custom format info: | ||
+ | < | ||
+ | sinfo -N -o "%N %P %.11T %.15f" | ||
+ | </ | ||
+ | |||
+ | === CPU core allocation === | ||
+ | |||
+ | The minimal computing resource in SLURM is one CPU core. However, CPU count advertised by SLURM corresponds to the number of CPU threads. | ||
+ | If you ask for 1 CPU core with < | ||
+ | |||
+ | For example '' | ||
+ | |||
+ | < | ||
+ | $> scontrol show node dll-8gpu1 | ||
+ | $ scontrol show node dll-8gpu1 | ||
+ | NodeName=dll-8gpu1 Arch=x86_64 CoresPerSocket=16 | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | </ | ||
+ | |||
+ | In the example above you can see comments at all lines relevant to CPU allocation. | ||
+ | |||
+ | |||
+ | |||
==== Interactive mode ==== | ==== Interactive mode ==== | ||
+ | This mode can be useful for testing You should be using batch mode for any serious computation. | ||
You can use **'' | You can use **'' | ||
Line 15: | Line 159: | ||
< | < | ||
- | Where: | + | |
- | | + | |
* '' | * '' | ||
+ | To get interactive job with a single GPU of any kind: | ||
+ | < | ||
+ | * '' | ||
+ | * '' | ||
+ | |||
+ | < | ||
+ | * '' | ||
+ | * '' | ||
+ | * '' | ||
+ | |||
+ | < | ||
+ | * '' | ||
+ | |||
+ | To see all the available options type: | ||
+ | < | ||