GPUs are requested via the
sbatch --gpus=1 ...
Specific GPU models (see table below) can be requested by indicating model and count:
sbatch --gpus=rtx2080ti:1 ...
|FHCRC||all||j||NVIDIA GTX 1080ti|
|FHCRC||all||k||NVIDIA RTX 2080ti|
|FHCRC||none (interactive use)||rhino||NVIDIA RTX1080ti|
When your job is assigned a GPU, Slurm sets the environment variable CUDA_VISIBLE_DEVICES. This environment variable indicates the assigned GPU- most CUDA tools (e.g. tensorflow) use this to restrict execution to that device.
Updated: March 31, 2023Edit this Page via GitHub Comment by Filing an Issue Have Questions? Ask them here.