Unix Shell and Command Line Basics
The Unix environment is incredibly powerful but quite daunting to the newcomer. Command line confidence unlocks powerful computing resources beyond the desktop, including virtual machines and High Performance Computing. It enables repetitive tasks to be automated. And it comes with a swag of...
Keywords: Research Computing, Unix
Unix Shell and Command Line Basics
https://intersect.org.au/training/course/unix101
https://dresa.org.au/materials/unix-shell-and-command-line-basics
The Unix environment is incredibly powerful but quite daunting to the newcomer. Command line confidence unlocks powerful computing resources beyond the desktop, including virtual machines and High Performance Computing. It enables repetitive tasks to be automated. And it comes with a swag of handy tools that can be combined in powerful ways. Getting started is the hardest part, but our helpful instructors are there to demystify Unix as you get to work running programs and writing scripts on the command line.
Every attendee is given a dedicated training environment for the duration of the workshop, with all software and data fully loaded and ready to run.
We teach this course within a GNU/Linux environment. This is best characterised as a Unix-like environment. We teach how to run commands within the Bash Shell. The skills you'll learn at this course are generally transferable to other Unix environments.
#### You'll learn:
- Navigate and work with files and directories (folders)
- Use a selection of essential tools
- Combine data and tools to build a processing workflow
- Automate repetitive analysis using the command line
#### Prerequisites:
The course has no prerequisites.
**For more information, please click [here](https://intersect.org.au/training/course/unix101).**
training@intersect.org.au
Research Computing, Unix
From PC to Cloud or High Performance Computing
Most of you would have heard of Cloud and High Performance Computing (HPC), or you may already be using it. HPC is not the same as cloud computing. Both technologies differ in a number of ways, and have some similarities as well.
We may refer to both types as “large scale computing” - but what...
Keywords: Research Computing
From PC to Cloud or High Performance Computing
https://intersect.org.au/training/course/compute001
https://dresa.org.au/materials/from-pc-to-cloud-or-high-performance-computing
Most of you would have heard of Cloud and High Performance Computing (HPC), or you may already be using it. HPC is not the same as cloud computing. Both technologies differ in a number of ways, and have some similarities as well.
We may refer to both types as “large scale computing” - but what is the difference? Both systems target scalability of computing, but in different ways.
This webinar will give a good overview to the researchers thinking to make a move from their local computer to Cloud of High Performance Computing Cluster.
#### You'll learn:
- Introduction
- HPC vs Cloud computing
- When to use HPC
- When to use the Cloud
- The Cloud – Pros and Cons
- HPC – Pros and Cons
#### Prerequisites:
The webinar has no prerequisites.
**For more information, please click [here](https://intersect.org.au/training/course/compute001).**
training@intersect.org.au
Research Computing
Getting started with HPC using PBS Pro
Is your computer's limited power throttling your research ambitions? Are your analysis scripts pushing your laptop's processor to its limits? Is your software crashing because you’ve run out of memory? Would you like to unleash to power of the Unix command line to automate and run your analysis...
Keywords: Research Computing, HPC
Getting started with HPC using PBS Pro
https://intersect.org.au/training/course/hpc201
https://dresa.org.au/materials/getting-started-with-hpc-using-pbs-pro
Is your computer's limited power throttling your research ambitions? Are your analysis scripts pushing your laptop's processor to its limits? Is your software crashing because you’ve run out of memory? Would you like to unleash to power of the Unix command line to automate and run your analysis on supercomputers that you can access for free?
High-Performance Computing (HPC) allows you to accomplish your analysis faster by using many parallel CPUs and huge amounts of memory simultaneously. This course provides a hands on introduction to running software on HPC infrastructure using PBS Pro.
#### You'll learn:
- Connect to an HPC cluster
- Use the Unix command line to operate a remote computer and create job scripts
- Submit and manage jobs on a cluster using a scheduler
- Transfer files to and from a remote computer
- Use software through environment modules
- Use parallelisation to speed up data analysis
- Access the facilities available to you as a researcher
- This is the PBS Pro version of the Getting Started with HPC course.
#### Prerequisites:
This course assumes basic familiarity with the Bash command line environment found on GNU/Linux and other Unix-like environments. To come up to speed, consider taking our [Unix Shell and Command Line Basics](https://intersect.org.au/training/course/unix101/) course.
**For more information, please click [here](https://intersect.org.au/training/course/hpc201).**
training@intersect.org.au
Research Computing, HPC
Getting started with HPC using Slurm
Is your computer's limited power throttling your research ambitions? Are your analysis scripts pushing your laptop's processor to its limits? Is your software crashing because you’ve run out of memory? Would you like to unleash to power of the Unix command line to automate and run your analysis...
Keywords: Research Computing, HPC
Getting started with HPC using Slurm
https://intersect.org.au/training/course/hpc202
https://dresa.org.au/materials/getting-started-with-hpc-using-slurm
Is your computer's limited power throttling your research ambitions? Are your analysis scripts pushing your laptop's processor to its limits? Is your software crashing because you’ve run out of memory? Would you like to unleash to power of the Unix command line to automate and run your analysis on supercomputers that you can access for free?
High-Performance Computing (HPC) allows you to accomplish your analysis faster by using many parallel CPUs and huge amounts of memory simultaneously. This course provides a hands on introduction to running software on HPC infrastructure using Slurm.
#### You'll learn:
- Connect to an HPC cluster
- Use the Unix command line to operate a remote computer and create job scripts
- Submit and manage jobs on a cluster using a scheduler
- Transfer files to and from a remote computer
- Use software through environment modules
- Use parallelisation to speed up data analysis
- Access the facilities available to you as a researcher
- This is the Slurm version of the Getting Started with HPC course.
#### Prerequisites:
This course assumes basic familiarity with the Bash command line environment found on GNU/Linux and other Unix-like environments. To come up to speed, consider taking our [Unix Shell and Command Line Basics](https://intersect.org.au/training/course/unix101/) course.
**For more information, please click [here](https://intersect.org.au/training/course/hpc202).**
training@intersect.org.au
Research Computing, HPC
Parallel Programming for HPC
You have written, compiled and run functioning programs in C and/or Fortran. You know how HPC works and you've submitted batch jobs.
Now you want to move from writing single-threaded programs into the parallel programming paradigm, so you can truly harness the full power of High Performance...
Keywords: Research Computing, HPC
Parallel Programming for HPC
https://intersect.org.au/training/course/hpc301
https://dresa.org.au/materials/parallel-programming-for-hpc
You have written, compiled and run functioning programs in C and/or Fortran. You know how HPC works and you've submitted batch jobs.
Now you want to move from writing single-threaded programs into the parallel programming paradigm, so you can truly harness the full power of High Performance Computing.
#### You'll learn:
- OpenMP (Open Multi-Processing): a widespread method for shared memory programming
- MPI (Message Passing Interface): a leading distributed memory programming model
#### Prerequisites:
To do this course you need to have:
A good working knowledge of HPC. Consider taking our
Getting Started with HPC using PBS Pro course to come up to speed beforehand.
Prior experience of writing programs in either C or Fortran.
**For more information, please click [here](https://intersect.org.au/training/course/hpc301).**
training@intersect.org.au
Research Computing, HPC
