WEBINAR: Where to go when your bioinformatics outgrows your compute
This record includes training materials associated with the Australian BioCommons webinar ‘Where to go when your bioinformatics outgrows your compute’. This webinar took place on 19 August 2021.
Bioinformatics analyses are often complex, requiring multiple software tools and specialised compute...
Keywords: Computational Biology, Bioinformatics, High performance computing, HPC, Galaxy Australia, Nectar Research Cloud, Pawsey Supercomputing Centre, NCI, NCMAS, Cloud computing
WEBINAR: Where to go when your bioinformatics outgrows your compute
https://zenodo.org/records/5240578
https://dresa.org.au/materials/webinar-where-to-go-when-your-bioinformatics-outgrows-your-compute-7a5a0ff8-8f4f-4fd0-af20-a88d515a6554
This record includes training materials associated with the Australian BioCommons webinar ‘Where to go when your bioinformatics outgrows your compute’. This webinar took place on 19 August 2021.
Bioinformatics analyses are often complex, requiring multiple software tools and specialised compute resources. “I don’t know what compute resources I will need”, “My analysis won’t run and I don’t know why” and "Just getting it to work" are common pain points for researchers. In this webinar, you will learn how to understand the compute requirements for your bioinformatics workflows. You will also hear about ways of accessing compute that suits your needs as an Australian researcher, including Galaxy Australia, cloud and high-performance computing services offered by the Australian Research Data Commons, the National Compute Infrastructure (NCI) and Pawsey. We also describe bioinformatics and computing support services available to Australian researchers.
This webinar was jointly organised with the Sydney Informatics Hub at the University of Sydney.
Materials are shared under a Creative Commons Attribution 4.0 International agreement unless otherwise specified and were current at the time of the event.
Files and materials included in this record:
Event metadata (PDF): Information about the event including, description, event URL, learning objectives, prerequisites, technical requirements etc.
Index of training materials (PDF): List and description of all materials associated with this event including the name, format, location and a brief description of each file.
Where to go when your bioinformatics outgrows your compute - slides (PDF and PPTX): Slides presented during the webinar
Australian research computing resources cheat sheet (PDF): A list of resources and useful links mentioned during the webinar.
Materials shared elsewhere:
A recording of the webinar is available on the Australian BioCommons YouTube Channel:
https://youtu.be/hNTbngSc-W0
Melissa Burke (melissa@biocommons.org.au)
Samaha, Georgina (orcid: 0000-0003-0419-1476)
Chew, Tracy (orcid: 0000-0001-9529-7705)
Sadsad, Rosemarie (orcid: 0000-0003-2488-953X)
Coddington, Paul (orcid: 0000-0003-1336-9686)
Gladman, Simon (orcid: 0000-0002-6100-4385)
Edberg, Roger
Shaikh, Javed
Cytowski, Maciej (orcid: 0000-0002-0007-0979)
Computational Biology, Bioinformatics, High performance computing, HPC, Galaxy Australia, Nectar Research Cloud, Pawsey Supercomputing Centre, NCI, NCMAS, Cloud computing
WEBINAR: Portable, reproducible and scalable bioinformatics workflows using Nextflow and Pawsey Nimbus Cloud
This record includes training materials associated with the Australian BioCommons webinar ‘Portable, reproducible and scalable bioinformatics workflows using Nextflow and Pawsey Nimbus Cloud’. This webinar took place on 20 September 2022.
Event description
Bioinformatics workflows can support...
Keywords: Bioinformatics, Workflows, Nextflow, Containerisation
WEBINAR: Portable, reproducible and scalable bioinformatics workflows using Nextflow and Pawsey Nimbus Cloud
https://zenodo.org/records/7095271
https://dresa.org.au/materials/webinar-portable-reproducible-and-scalable-bioinformatics-workflows-using-nextflow-and-pawsey-nimbus-cloud-824bc004-4dcb-4bb5-b0dc-a207c44bbbe6
This record includes training materials associated with the Australian BioCommons webinar ‘Portable, reproducible and scalable bioinformatics workflows using Nextflow and Pawsey Nimbus Cloud’. This webinar took place on 20 September 2022.
Event description
Bioinformatics workflows can support portable, reproducible and scalable analysis of omics datasets but using workflows can be challenging for both beginners and experienced bioinformaticians. Beginners face a steep learning curve to be able to build and deploy their own bioinformatics workflows while those with more experience face challenges productionising and scaling code for custom workflows and big data.
Bioinformaticians across the world are using Nextflow to build and manage workflows. Many of these workflows are shared for others to use and supported by the community via nf-co.re. So far, 39 workflows for omics data are available with another 23 under development. These workflows cover common analyses such as RNAseq, mapping, variant calling, single cell transcriptomics and more and can be easily deployed by anyone, regardless of skill level.
In this webinar, Nandan Deshpande from the Sydney Informatics Hub, University of Sydney, will discuss how you can deploy freely available Nextflow (nf.co-re) bioinformatics workflows with a single command. We describe how you can quickly get started deploying these workflows using Pawsey Nimbus Cloud. For advanced users, we introduce you to Nextflow concepts to get you started with building your own workflows that will save you time and support reproducible, portable and scalable analysis.
In the latter half of the webinar, Sarah Beecroft from the Pawsey Supercomputing Research Centre will talk about their Nimbus Cloud systems. While Nextflow supports portability and can run on many computing infrastructures, we describe why we specifically love using Nimbus with Nextflow for many bioinformatics projects. We will describe some of the nf.co-re workflows that we have used on Nimbus and the research outcomes. We will also cover when not to use Nimbus and the alternatives we recommend.
Materials are shared under a Creative Commons Attribution 4.0 International agreement unless otherwise specified and were current at the time of the event.
Files and materials included in this record:
Event metadata (PDF): Information about the event including, description, event URL, learning objectives, prerequisites, technical requirements etc.
Index of training materials (PDF): List and description of all materials associated with this event including the name, format, location and a brief description of each file.
Nextflow_Nimbus_slides (PDF): A PDF copy of the slides presented during the webinar.
Materials shared elsewhere:
A recording of this webinar is available on the Australian BioCommons YouTube Channel:
https://youtu.be/VnLX63yXbJU
Melissa Burke (melissa@biocommons.org.au)
Deshpande, Nandan (orcid: 0000-0002-0324-8728)
Beecroft, Sarah (orcid: 0000-0002-3935-2279)
Bioinformatics, Workflows, Nextflow, Containerisation