WEBINAR: Where to go when your bioinformatics outgrows your compute
This record includes training materials associated with the Australian BioCommons webinar ‘Where to go when your bioinformatics outgrows your compute’. This webinar took place on 19 August 2021.
Bioinformatics analyses are often complex, requiring multiple software tools and specialised compute...
Keywords: Computational Biology, Bioinformatics, High performance computing, HPC, Galaxy Australia, Nectar Research Cloud, Pawsey Supercomputing Centre, NCI, NCMAS, Cloud computing
WEBINAR: Where to go when your bioinformatics outgrows your compute
https://zenodo.org/records/5240578
https://dresa.org.au/materials/webinar-where-to-go-when-your-bioinformatics-outgrows-your-compute-7a5a0ff8-8f4f-4fd0-af20-a88d515a6554
This record includes training materials associated with the Australian BioCommons webinar ‘Where to go when your bioinformatics outgrows your compute’. This webinar took place on 19 August 2021.
Bioinformatics analyses are often complex, requiring multiple software tools and specialised compute resources. “I don’t know what compute resources I will need”, “My analysis won’t run and I don’t know why” and "Just getting it to work" are common pain points for researchers. In this webinar, you will learn how to understand the compute requirements for your bioinformatics workflows. You will also hear about ways of accessing compute that suits your needs as an Australian researcher, including Galaxy Australia, cloud and high-performance computing services offered by the Australian Research Data Commons, the National Compute Infrastructure (NCI) and Pawsey. We also describe bioinformatics and computing support services available to Australian researchers.
This webinar was jointly organised with the Sydney Informatics Hub at the University of Sydney.
Materials are shared under a Creative Commons Attribution 4.0 International agreement unless otherwise specified and were current at the time of the event.
Files and materials included in this record:
Event metadata (PDF): Information about the event including, description, event URL, learning objectives, prerequisites, technical requirements etc.
Index of training materials (PDF): List and description of all materials associated with this event including the name, format, location and a brief description of each file.
Where to go when your bioinformatics outgrows your compute - slides (PDF and PPTX): Slides presented during the webinar
Australian research computing resources cheat sheet (PDF): A list of resources and useful links mentioned during the webinar.
Materials shared elsewhere:
A recording of the webinar is available on the Australian BioCommons YouTube Channel:
https://youtu.be/hNTbngSc-W0
Melissa Burke (melissa@biocommons.org.au)
Samaha, Georgina (orcid: 0000-0003-0419-1476)
Chew, Tracy (orcid: 0000-0001-9529-7705)
Sadsad, Rosemarie (orcid: 0000-0003-2488-953X)
Coddington, Paul (orcid: 0000-0003-1336-9686)
Gladman, Simon (orcid: 0000-0002-6100-4385)
Edberg, Roger
Shaikh, Javed
Cytowski, Maciej (orcid: 0000-0002-0007-0979)
Computational Biology, Bioinformatics, High performance computing, HPC, Galaxy Australia, Nectar Research Cloud, Pawsey Supercomputing Centre, NCI, NCMAS, Cloud computing
WORKSHOP: Refining genome annotations with Apollo
This record includes training materials associated with the Australian BioCommons workshop ‘Refining genome annotations with Apollo’. This workshop took place on 17 November 2021.
Workshop description
Genome annotation is crucial to defining the function of genomic sequences. This process...
Keywords: Apollo Software, Bioinformatics, Analysis, Workflows, Genomics, Genome annotation
WORKSHOP: Refining genome annotations with Apollo
https://zenodo.org/records/5781812
https://dresa.org.au/materials/workshop-refining-genome-annotations-with-apollo-d8f95fb3-7dc4-40e0-87d5-e7a4b2ceaf16
This record includes training materials associated with the Australian BioCommons workshop ‘Refining genome annotations with Apollo’. This workshop took place on 17 November 2021.
Workshop description
Genome annotation is crucial to defining the function of genomic sequences. This process typically involves a round of automated annotation followed by manual curation. Manual curation allows you to visualise your annotations so you can understand what your organism looks like, and then to manually refine these annotations along with any additional data you might have. This process is typically performed collaboratively as part of a team effort.
Apollo is a popular tool for facilitating real-time collaborative, manual curation and genome annotation editing. In this workshop we will learn how to use Apollo to refine genome annotations using example data from an E. coli strain. We’ll focus on the basics like getting data into Apollo, viewing evidence tracks, editing and adding structural and functional annotation, visualising the results and collaborating on genome annotations.
This workshop made use of a training instance of the new Australian Apollo Service. This service enables Australian-based research groups and consortia to access Apollo and host genome assembly and supporting evidence files for free. This service has been made possible by The Australian BioCommons and partners at QCIF and Pawsey. To learn more about the Australian Apollo Service you can watch the Australian Apollo Launch Webinar.
This workshop was presented by the Australian BioCommons and Queensland Cyber Infrastructure Foundation (QCIF) .
The Australian Apollo Service is operated by QCIF and underpinned by computational resources provided by the Pawsey Supercomputing Research Centre and receives NCRIS funding through Bioplatforms Australia and the Australian Research Data Commons as well as Queensland Government RICF funding.
The training materials presented in this workshop were developed by Anthony Bretaudeau, Helena Rasche, Nathan Dunn, Mateo Boudet for the Galaxy Training Network. Helena and Anthony are part of the Gallantries project which is supported by Erasmus Programme of the European Union.
Materials are shared under a Creative Commons Attribution 4.0 International agreement unless otherwise specified and were current at the time of the event.
Files and materials included in this record:
Event metadata (PDF): Information about the event including, description, event URL, learning objectives, prerequisites, technical requirements etc.
Index of training materials (PDF): List and description of all materials associated with this event including the name, format, location and a brief description of each file.
Schedule (PDF): A breakdown of the topics and timings for the workshop
2021 Apollo Training Intro (PPTX and PDF): Slides used to introduce the Australian Apollo Service
Augustus.gff3 (gff3): E.coli derived data file used in the tutorial. Data was obtained from the Galaxy Training Network and pre-processed using Galaxy Australia.
Blastp_vs_swissprot.gff3: E.coli derived data file used in the tutorial. Data was obtained from the Galaxy Training Network and pre-processed using Galaxy Australia.
Materials shared elsewhere:
This workshop is based on the tutorial ‘Refining genome annotations with Apollo’ which was developed for the Galaxy Training Network.
Anthony Bretaudeau, Helena Rasche, Nathan Dunn, Mateo Boudet, Erasmus Programme, 2021 Refining Genome Annotations with Apollo (Galaxy Training Materials). https://training.galaxyproject.org/training-material/topics/genome-annotation/tutorials/apollo/tutorial.html Online; accessed Wed Dec 15 2021
See also:
Batut et al., 2018 Community-Driven Data Analysis Training for Biology Cell Systems 10.1016/j.cels.2018.05.012
Melissa Burke (melissa@biocommons.org.au)
Bretaudeau, Anthony (orcid: 0000-0003-0914-2470)
Rasche, Helena (orcid: 0000-0001-9760-8992)
Williams, Sarah
Nelson, Tiffanie (orcid: 0000-0002-5341-312X)
Thang, Mike
Lee, Justin
Apollo Software, Bioinformatics, Analysis, Workflows, Genomics, Genome annotation
WORKSHOP: Refining genome annotations with Apollo
This record includes training materials associated with the Australian BioCommons workshop ‘Refining genome annotations with Apollo’. This workshop took place on 17 November 2021.
Workshop description
Genome annotation is crucial to defining the function of genomic sequences. This...
Keywords: Apollo Software, Bioinformatics, Analysis, Workflows, Genomics, Genome annotation
WORKSHOP: Refining genome annotations with Apollo
https://zenodo.org/record/5781812
https://dresa.org.au/materials/workshop-refining-genome-annotations-with-apollo
This record includes training materials associated with the Australian BioCommons workshop ‘Refining genome annotations with Apollo’. This workshop took place on 17 November 2021.
**Workshop description**
Genome annotation is crucial to defining the function of genomic sequences. This process typically involves a round of automated annotation followed by manual curation. Manual curation allows you to visualise your annotations so you can understand what your organism looks like, and then to manually refine these annotations along with any additional data you might have. This process is typically performed collaboratively as part of a team effort.
Apollo is a popular tool for facilitating real-time collaborative, manual curation and genome annotation editing. In this workshop we will learn how to use Apollo to refine genome annotations using example data from an E. coli strain. We’ll focus on the basics like getting data into Apollo, viewing evidence tracks, editing and adding structural and functional annotation, visualising the results and collaborating on genome annotations.
This workshop made use of a training instance of the new Australian Apollo Service. This service enables Australian-based research groups and consortia to access Apollo and host genome assembly and supporting evidence files for free. This service has been made possible by The Australian BioCommons and partners at QCIF and Pawsey. To learn more about the Australian Apollo Service you can watch the Australian Apollo Launch Webinar.
This workshop was presented by the Australian BioCommons and Queensland Cyber Infrastructure Foundation (QCIF) .
The Australian Apollo Service is operated by QCIF and underpinned by computational resources provided by the Pawsey Supercomputing Research Centre and receives NCRIS funding through Bioplatforms Australia and the Australian Research Data Commons as well as Queensland Government RICF funding.
The training materials presented in this workshop were developed by Anthony Bretaudeau, Helena Rasche, Nathan Dunn, Mateo Boudet for the Galaxy Training Network. Helena and Anthony are part of the Gallantries project which is supported by Erasmus Programme of the European Union.
Materials are shared under a Creative Commons Attribution 4.0 International agreement unless otherwise specified and were current at the time of the event.
**Files and materials included in this record:**
- Event metadata (PDF): Information about the event including, description, event URL, learning objectives, prerequisites, technical requirements etc.
- Index of training materials (PDF): List and description of all materials associated with this event including the name, format, location and a brief description of each file.
- Schedule (PDF): A breakdown of the topics and timings for the workshop
- 2021 Apollo Training Intro (PPTX and PDF): Slides used to introduce the Australian Apollo Service
- Augustus.gff3 (gff3): E.coli derived data file used in the tutorial. Data was obtained from the Galaxy Training Network and pre-processed using Galaxy Australia.
- Blastp_vs_swissprot.gff3: E.coli derived data file used in the tutorial. Data was obtained from the Galaxy Training Network and pre-processed using Galaxy Australia.
**Materials shared elsewhere:**
This workshop is based on the tutorial ‘Refining genome annotations with Apollo’ which was developed for the Galaxy Training Network.
Anthony Bretaudeau, Helena Rasche, Nathan Dunn, Mateo Boudet, Erasmus Programme, 2021 Refining Genome Annotations with Apollo (Galaxy Training Materials). https://training.galaxyproject.org/training-material/topics/genome-annotation/tutorials/apollo/tutorial.html Online; accessed Wed Dec 15 2021
See also:
Batut et al., 2018 Community-Driven Data Analysis Training for Biology Cell Systems 10.1016/j.cels.2018.05.012
Melissa Burke (melissa@biocommons.org.au)
Bretaudeau, Anthony (orcid: 0000-0003-0914-2470)
Rasche, Helena (orcid: 0000-0001-9760-8992)
Williams, Sarah
Nelson, Tiffanie (orcid: 0000-0002-5341-312X)
Thang, Mike
Lee, Justin
Apollo Software, Bioinformatics, Analysis, Workflows, Genomics, Genome annotation
WEBINAR: Where to go when your bioinformatics outgrows your compute
This record includes training materials associated with the Australian BioCommons webinar ‘Where to go when your bioinformatics outgrows your compute’. This webinar took place on 19 August 2021.
Bioinformatics analyses are often complex, requiring multiple software tools and specialised...
Keywords: Computational Biology, Bioinformatics, High performance computing, HPC, Galaxy Australia, Nectar Research Cloud, Pawsey Supercomputing Centre, NCI, NCMAS, Cloud computing
WEBINAR: Where to go when your bioinformatics outgrows your compute
https://zenodo.org/record/5240578
https://dresa.org.au/materials/webinar-where-to-go-when-your-bioinformatics-outgrows-your-compute
This record includes training materials associated with the Australian BioCommons webinar ‘Where to go when your bioinformatics outgrows your compute’. This webinar took place on 19 August 2021.
Bioinformatics analyses are often complex, requiring multiple software tools and specialised compute resources. “I don’t know what compute resources I will need”, “My analysis won’t run and I don’t know why” and "Just getting it to work" are common pain points for researchers. In this webinar, you will learn how to understand the compute requirements for your bioinformatics workflows. You will also hear about ways of accessing compute that suits your needs as an Australian researcher, including Galaxy Australia, cloud and high-performance computing services offered by the Australian Research Data Commons, the National Compute Infrastructure (NCI) and Pawsey. We also describe bioinformatics and computing support services available to Australian researchers.
This webinar was jointly organised with the Sydney Informatics Hub at the University of Sydney.
Materials are shared under a Creative Commons Attribution 4.0 International agreement unless otherwise specified and were current at the time of the event.
**Files and materials included in this record:**
- Event metadata (PDF): Information about the event including, description, event URL, learning objectives, prerequisites, technical requirements etc.
- Index of training materials (PDF): List and description of all materials associated with this event including the name, format, location and a brief description of each file.
- Where to go when your bioinformatics outgrows your compute - slides (PDF and PPTX): Slides presented during the webinar
- Australian research computing resources cheat sheet (PDF): A list of resources and useful links mentioned during the webinar.
**Materials shared elsewhere:**
A recording of the webinar is available on the Australian BioCommons YouTube Channel:
https://youtu.be/hNTbngSc-W0
Melissa Burke (melissa@biocommons.org.au)
Samaha, Georgina (orcid: 0000-0003-0419-1476)
Chew, Tracy (orcid: 0000-0001-9529-7705)
Sadsad, Rosemarie (orcid: 0000-0003-2488-953X)
Coddington, Paul (orcid: 0000-0003-1336-9686)
Gladman, Simon (orcid: 0000-0002-6100-4385)
Edberg, Roger
Shaikh, Javed
Cytowski, Maciej (orcid: 0000-0002-0007-0979)
Computational Biology, Bioinformatics, High performance computing, HPC, Galaxy Australia, Nectar Research Cloud, Pawsey Supercomputing Centre, NCI, NCMAS, Cloud computing
Deep Learning for Natural Language Processing
This workshop is designed to be instructor led and consists of two parts.
Part 1 consists of a lecture-demo about text processing and a hands-on session for attendees to learn how to clean a dataset.
Part 2 consists of a lecture introducing Recurrent Neural Networks and a hands-on session for...
Keywords: Deep learning, NLP, Machine learning
Resource type: presentation, tutorial
Deep Learning for Natural Language Processing
https://doi.org/10.26180/13100513
https://dresa.org.au/materials/deep-learning-for-natural-language-processing
This workshop is designed to be instructor led and consists of two parts.
Part 1 consists of a lecture-demo about text processing and a hands-on session for attendees to learn how to clean a dataset.
Part 2 consists of a lecture introducing Recurrent Neural Networks and a hands-on session for attendees to train their own RNN.
The Powerpoints contain the lecture slides, while the Jupyter notebooks (.ipynb) contain the hands-on coding exercises.
This workshop introduces natural language as data for deep learning. We discuss various techniques and software packages (e.g. python strings, RegEx, NLTK, Word2Vec) that help us convert, clean, and formalise text data “in the wild” for use in a deep learning model. We then explore the training and testing of a Recurrent Neural Network on the data to complete a real world task. We will be using TensorFlow v2 for this purpose.
datascienceplatform@monash.edu
Titus Tang
Deep learning, NLP, Machine learning
Getting Started with Deep Learning
This lecture provides a high level overview of how you could get started with developing deep learning applications. It introduces deep learning in a nutshell and then provides advice relating to the concepts and skill sets you would need to know and have in order to build a deep learning...
Keywords: Deep learning, Machine learning
Resource type: presentation
Getting Started with Deep Learning
https://doi.org/10.26180/15032688
https://dresa.org.au/materials/getting-started-with-deep-learning
This lecture provides a high level overview of how you could get started with developing deep learning applications. It introduces deep learning in a nutshell and then provides advice relating to the concepts and skill sets you would need to know and have in order to build a deep learning application. The lecture also provides pointers to various resources you could use to gain a stronger foothold in deep learning.
This lecture is targeted at researchers who may be complete beginners in machine learning, deep learning, or even with programming, but who would like to get into the space to build AI systems hands-on.
datascienceplatform@monash.edu
Titus Tang
Deep learning, Machine learning
Semi-Supervised Deep Learning
Modern deep neural networks require large amounts of labelled data to train. Obtaining the required labelled data is often an expensive and time consuming process. Semi-supervised deep learning involves the use of various creative techniques to train deep neural networks on partially labelled...
Keywords: Deep learning, Machine learning, semi-supervised
Resource type: presentation, tutorial
Semi-Supervised Deep Learning
https://doi.org/10.26180/14176805
https://dresa.org.au/materials/semi-supervised-deep-learning
Modern deep neural networks require large amounts of labelled data to train. Obtaining the required labelled data is often an expensive and time consuming process. Semi-supervised deep learning involves the use of various creative techniques to train deep neural networks on partially labelled data. If successful, it allows better training of a model despite the limited amount of labelled data available.
This workshop is designed to be instructor led and covers various semi-supervised learning techniques available in the literature. The workshop consists of a lecture introducing at a high level a selection of techniques that are suitable for semi-supervised deep learning. We discuss how these techniques can be implemented and the underlying assumptions they require. The lecture is followed by a hands-on session where attendees implement a semi-supervised learning technique to train a neural network. We observe and discuss the changing performance and behaviour of the network as varying degrees of labelled and unlabelled data is provided to the network during training.
datascienceplatform@monash.edu
Titus Tang
Deep learning, Machine learning, semi-supervised
Introduction to Deep Learning and TensorFlow
This workshop is intended to run as an instructor guided live event and consists of two parts. Each part consists of a lecture and a hands-on coding exercise.
Part 1 - Introduction to Deep Learning and TensorFlow
Part 2 - Introduction to Convolutional Neural Networks
The Powerpoints contain...
Keywords: Deep learning, convolutional neural network, tensorflow, Machine learning
Resource type: presentation, tutorial
Introduction to Deep Learning and TensorFlow
https://doi.org/10.26180/13100519
https://dresa.org.au/materials/introduction-to-deep-learning-and-tensorflow
This workshop is intended to run as an instructor guided live event and consists of two parts. Each part consists of a lecture and a hands-on coding exercise.
Part 1 - Introduction to Deep Learning and TensorFlow
Part 2 - Introduction to Convolutional Neural Networks
The Powerpoints contain the lecture slides, while the Jupyter notebooks (.ipynb) contain the hands-on coding exercises.
This workshop is an introduction to how deep learning works and how you could create a neural network using TensorFlow v2. We start by learning the basics of deep learning including what a neural network is, how information passes through the network, and how the network learns from data through the automated process of gradient descent. Workshop attendees would build, train and evaluate a neural network using a cloud GPU (Google Colab).
In part 2, we look at image data and how we could train a convolution neural network to classify images. Workshop attendees will extend their knowledge from the first part to design, train and evaluate this convolutional neural network.
datascienceplatform@monash.edu
Titus Tang
Deep learning, convolutional neural network, tensorflow, Machine learning
WEBINAR: Getting started with deep learning
This record includes training materials associated with the Australian BioCommons webinar ‘Getting started with deep learning’. This webinar took place on 21 July 2021.
Are you wondering what deep learning is and how it might be useful in your research? This high level overview introduces...
Keywords: Deep learning, Bioinformatics, Machine learning
Resource type: video, presentation
WEBINAR: Getting started with deep learning
https://zenodo.org/record/5121004#.YQN_QlMzY3Q
https://dresa.org.au/materials/webinar-getting-started-with-deep-learning
This record includes training materials associated with the Australian BioCommons webinar ‘Getting started with deep learning’. This webinar took place on 21 July 2021.
Are you wondering what deep learning is and how it might be useful in your research? This high level overview introduces deep learning ‘in a nutshell’ and provides tips on which concepts and skills you will need to know to build a deep learning application. The presentation also provides pointers to various resources you can use to get started in deep learning.
The webinar is followed by a short Q&A session.
Materials are shared under a Creative Commons Attribution 4.0 International agreement unless otherwise specified and were current at the time of the event.
Files and materials included in this record:
Event metadata (PDF): Information about the event including, description, event URL, learning objectives, prerequisites, technical requirements etc.
Index of training materials (PDF): List and description of all materials associated with this event including the name, format, location and a brief description of each file.
Getting Started with Deep Learning - Slides (PDF): Slides used in the presentation
Materials shared elsewhere:
A recording of the webinar is available on the Australian BioCommons YouTube Channel:
https://youtu.be/I1TmpnZUuiQ
Melissa Burke (melissa@biocommons.org.au)
Titus Tang
Deep learning, Bioinformatics, Machine learning