Managing Data using Acacia @ Pawsey
Acacia is Pawsey's "warm tier" or project storage. This object store is fully integrated with Setonix, Pawsey's main supercomputer, enabling fast transfer of data for project use.
These short videos introduce this high-speed object storage for hosting research data online.
Acacia is named...
Keywords: data, data skills, Acacia, Pawsey Supercomputing Centre, object storage, File systems
Managing Data using Acacia @ Pawsey
https://www.youtube.com/playlist?list=PLmu61dgAX-aYxrbqtSYHS1ufVZ9xs1AnI
https://dresa.org.au/materials/managing-data-using-acacia-pawsey
Acacia is Pawsey's "warm tier" or project storage. This object store is fully integrated with Setonix, Pawsey's main supercomputer, enabling fast transfer of data for project use.
These short videos introduce this high-speed object storage for hosting research data online.
Acacia is named after Australia’s national floral emblem the Golden Wattle – Acacia pycnantha.
training@pawsey.org.au
Pawsey Supercomputing Research Centre
data, data skills, Acacia, Pawsey Supercomputing Centre, object storage, File systems
ugrad
masters
phd
ecr
researcher
support
professional
PCon Preparing applications for El Capitan and beyond
As Lawrence Livermore National Laboratories (LLNL) prepares to stand up its next supercomputer, El Capitan, application teams prepare to pivot to another GPU architecture.
This talk presents how the LLNL application teams made the transition from distributed-memory, CPU-only architectures to...
Keywords: GPUs, supercomputing, HPC, PaCER
PCon Preparing applications for El Capitan and beyond
https://www.youtube.com/watch?v=cj7a7gWgt8o&list=PLmu61dgAX-aZ_aa6SmmExSJtXGS7L_BF9&index=4
https://dresa.org.au/materials/pcon-preparing-applications-for-el-capitan-and-beyond
As Lawrence Livermore National Laboratories (LLNL) prepares to stand up its next supercomputer, El Capitan, application teams prepare to pivot to another GPU architecture.
This talk presents how the LLNL application teams made the transition from distributed-memory, CPU-only architectures to GPUs. They share institutional best practices. They discuss new open-source software products as tools for porting and profiling applications and as avenues for collaboration across the computational science community.
Join LLNL's Erik Draeger and Jane Herriman, who presented this talk at Pawsey's PaCER Conference in September 2023.
training@pawsey.org.au
Erik Draeger
Jane Herriman
Pawsey Supercomputing Research Centre
GPUs, supercomputing, HPC, PaCER
masters
phd
researcher
ecr
support
professional
ugrad
Advanced Data Wrangling with OpenRefine
This online self-paced workshop teaches advanced data wrangling skills including combining datasets, geolocating data, and “what if” exploration using OpenRefine.
Keywords: data skills, data
Resource type: tutorial
Advanced Data Wrangling with OpenRefine
https://griffithunilibrary.github.io/advanced-data-wrangle-2/
https://dresa.org.au/materials/advanced-data-wrangling-with-openrefine
This online self-paced workshop teaches advanced data wrangling skills including combining datasets, geolocating data, and “what if” exploration using OpenRefine.
s.stapleton@griffith.edu.au
Sharron Stapleton
data skills, data
mbr
phd
ecr
researcher
support
professional
Introduction to Data Cleaning with OpenRefine
Learn basic data cleaning techniques in this self-paced online workshop using open data from data.qld.gov.au and open source tool OpenRefine openrefine.org. Learn techniques to prepare messy tabular data for comupational analysis. Of most relevance to HASS disciplines, working with textual data...
Keywords: data skills, Data analysis
Resource type: tutorial
Introduction to Data Cleaning with OpenRefine
https://griffithunilibrary.github.io/data-cleaning-intro/
https://dresa.org.au/materials/introduction-to-data-cleaning-with-openrefine
Learn basic data cleaning techniques in this self-paced online workshop using open data from data.qld.gov.au and open source tool OpenRefine openrefine.org. Learn techniques to prepare messy tabular data for comupational analysis. Of most relevance to HASS disciplines, working with textual data in a structured or semi-structured format.
s.stapleton@griffith.edu.au;
Sharron Stapleton
data skills, Data analysis
mbr
phd
ecr
researcher
support
professional
Introduction to Unix
A hands-on workshop covering the basics of the Unix command line interface.
Knowledge of the Unix operating system is fundamental to the use of many popular bioinformatics command-line tools. Whether you choose to run your analyses locally or on a high-performance computing system, knowing...
Keywords: Unix, Command line, Command-line, CLI
Resource type: tutorial
Introduction to Unix
https://www.melbournebioinformatics.org.au/tutorials/tutorials/unix/unix/
https://dresa.org.au/materials/introduction-to-unix
A hands-on workshop covering the basics of the Unix command line interface.
Knowledge of the Unix operating system is fundamental to the use of many popular bioinformatics command-line tools. Whether you choose to run your analyses locally or on a high-performance computing system, knowing your way around a command-line interface is highly valuable. This workshop will introduce you to Unix concepts by way of a series of hands-on exercises.
This workshop is designed for participants with little or no command-line knowledge.
Tools: Standard Unix commands, FileZilla
Topic overview:
Section 1: Getting started
Section 2: Exploring your current directory
Section 3: Making and changing directories
Section 4: Viewing and manipulating files
Section 5: Removing files and directories
Section 6: Searching files
Section 7: Putting it all together
Section 8: Transferring files
Tutorial instructions available here: https://www.melbournebioinformatics.org.au/tutorials/tutorials/unix/unix/
For queries relating to this workshop, contact Melbourne Bioinformatics (bioinformatics-training@unimelb.edu.au).
Find out when we are next running this training as an in-person workshop, by visiting the Melbourne Bioinformaitcs Eventbrite page: https://www.eventbrite.com.au/o/melbourne-bioinformatics-13058846490
For queries relating to this workshop, contact Melbourne Bioinformatics (bioinformatics-training@unimelb.edu.au).
Morgan, Steven (orcid: 0000-0001-6038-6126)
Unix, Command line, Command-line, CLI
ugrad
masters
mbr
phd
ecr
researcher
support
professional
Learn R or Python, generate Species Distribution Models (SDM) or SDM Climate Projections
EcoCommons has a variety of videos, R scripts, and support articles that introduce users to learning how to code in R or Python, how to generate Species Distribution Models (SDMs) or generate SDM climate projections.
We also have a growing number of use cases where users can see and work...
Keywords: Species Distribution Modelling, Beginner R coding, Beginer ecological modelling, Climate projections
Learn R or Python, generate Species Distribution Models (SDM) or SDM Climate Projections
https://www.ecocommons.org.au/learn-support/
https://dresa.org.au/materials/learn-r-or-python-generate-species-distribution-models-sdm-or-sdm-climate-projections
EcoCommons has a variety of videos, R scripts, and support articles that introduce users to learning how to code in R or Python, how to generate Species Distribution Models (SDMs) or generate SDM climate projections.
We also have a growing number of use cases where users can see and work through examples that highlight the power of bringing data together.
support@ecocommons.org.au
EcoCommons
Emilia Decker
Abhimanyu Singh
Robert Clemens
EcoCommons
Species Distribution Modelling, Beginner R coding, Beginer ecological modelling, Climate projections
ugrad
mbr
phd
ecr
professional
ARDC Research Data Rights Management Guide
A practical guide for people and organisations working with data, about rights information and licences, and to raise awareness of the implications of not having licences on data.
Who is this for? This guide is primarily directed toward members of the research sector, particularly data rights...
Keywords: research data
Resource type: guide
ARDC Research Data Rights Management Guide
https://zenodo.org/record/5091580#.YS26Co4zaUk
https://dresa.org.au/materials/ardc-research-data-rights-management-guide
A practical guide for people and organisations working with data, about rights information and licences, and to raise awareness of the implications of not having licences on data.
Who is this for? This guide is primarily directed toward members of the research sector, particularly data rights holders users and suppliers. Some general reference is made to characteristics and management of government data, acknowledging that this kind of data can be input to the research process. Government readers should consult their agency’s data management policies, in addition to reading this guide.
**Cite as**
Australian Research Data Commons. (2019). ARDC Research Data Rights Management Guide. Zenodo. https://doi.org/10.5281/zenodo.5091580
ARDC Contact us: contact@ardc.edu.au
Greg Laughlin
Baden Appleyard
research data
mbr
phd
ecr
researcher
support
professional