HPC file systems and what users need to consider for appropriate and efficient usage

Three videos on miscellaneous aspects of HPC usage - useful reference for new users of HPC systems.

1 – General overview of different file systems that might be available on HPC. The video goes through shared file systems such as /home and /scratch, local compute node file systems (local scratch or $TMPDIR) and storage file system. It outlines what users need to consider if they wish to use any of these in their workflows.
2 – Overview of the different directories that might be present on HPC. These could include /home, /scratch, /opt, /lib and lib64, /sw and others.
3 – Overview of the Message-of-the-day file and the message that is displayed to users every time they log in. This displays info about general help and often current problems or upcoming outages.

Licence: Standard YouTube Licence

Contact: QCIF Training (training@qcif.edu.au)

Keywords: HPC, high performance computer, File systems


Additional information

Resource type: Video Lecture, Presentation

Status: Active

Prerequisites:

You will need an account and connection details for the HPC system you are wanting to work with, and know how to connect to that system (see our Connecting to HPC guide for a suitable introduction)

Learning objectives:

  • Find out about the different file systems that might be available on HPC, including shared file systems, local compute file systems, and storage file systems
  • Learn how to use filesystems in your workflows.
  • Understand the function of some of the different directories that might be present on HPC. These could include /home, /scratch, /opt, /lib and lib64, /sw and others.
  • How to find out important user information from the Message-of-the-day file and the message that is displayed to users every time they log in.

Date modified: 2021-10-25

Date published: 2021-11-12

Authors: Marlies Hankel

HPC file systems and what users need to consider for appropriate and efficient usage https://dresa.org.au/materials/hpc-file-systems-and-what-users-need-to-consider-for-appropriate-and-efficient-usage Three videos on miscellaneous aspects of HPC usage - useful reference for new users of HPC systems. 1 – General overview of different file systems that might be available on HPC. The video goes through shared file systems such as /home and /scratch, local compute node file systems (local scratch or $TMPDIR) and storage file system. It outlines what users need to consider if they wish to use any of these in their workflows. 2 – Overview of the different directories that might be present on HPC. These could include /home, /scratch, /opt, /lib and lib64, /sw and others. 3 – Overview of the Message-of-the-day file and the message that is displayed to users every time they log in. This displays info about general help and often current problems or upcoming outages. QCIF Training (training@qcif.edu.au) HPC, high performance computer, File systems