Getting started with HPC using Slurm

Is your computer’s limited power throttling your research ambitions? Are your analysis scripts pushing your laptop’s processor to its limits? Is your software crashing because you’ve run out of memory? Would you like to unleash to power of the Unix command line to automate and run your analysis on supercomputers that you can access for free?

High-Performance Computing (HPC) allows you to accomplish your analysis faster by using many parallel CPUs and huge amounts of memory simultaneously. This course provides a hands on introduction to running software on HPC infrastructure using Slurm.

Connect to an HPC cluster

Use the Unix command line to operate a remote computer and create job scripts

Submit and manage jobs on a cluster using a scheduler

Transfer files to and from a remote computer

Use software through environment modules

Use parallelisation to speed up data analysis

Access the facilities available to you as a researcher

This is the Slurm version of the Getting Started with HPC course.

This course assumes basic familiarity with the Bash command line environment found on GNU/Linux and other Unix-like environments. To come up to speed, consider taking our \Unix Shell and Command Line Basics\ course.

DOI: 10.5281/zenodo.6423645

Licence: All Rights Reserved

Contact: training@intersect.org.au

Keywords: HPC


Additional information

Status: Active

Authors: Intersect Australia

Getting started with HPC using Slurm https://dresa.org.au/materials/getting-started-with-hpc-using-slurm Is your computer’s limited power throttling your research ambitions? Are your analysis scripts pushing your laptop’s processor to its limits? Is your software crashing because you’ve run out of memory? Would you like to unleash to power of the Unix command line to automate and run your analysis on supercomputers that you can access for free? High-Performance Computing (HPC) allows you to accomplish your analysis faster by using many parallel CPUs and huge amounts of memory simultaneously. This course provides a hands on introduction to running software on HPC infrastructure using Slurm. Connect to an HPC cluster Use the Unix command line to operate a remote computer and create job scripts Submit and manage jobs on a cluster using a scheduler Transfer files to and from a remote computer Use software through environment modules Use parallelisation to speed up data analysis Access the facilities available to you as a researcher This is the Slurm version of the Getting Started with HPC course. This course assumes basic familiarity with the Bash command line environment found on GNU/Linux and other Unix-like environments. To come up to speed, consider taking our \Unix Shell and Command Line Basics\ course. training@intersect.org.au HPC