Description:

Web scraping is a technique for extracting information from websites. This can be done manually but it is usually faster, more efficient and less error-prone if it can be automated.

Web scraping allows you to convert non-tabular or poorly structured data into a usable, structured format, such as a .csv file or spreadsheet. But scraping is about more than just acquiring data: it can help you track changes to data online, and help you archive data. In short, it's a skill worth learning.

So join us for this web scraping workshop to learn web scraping, using the researcher-focused training modules from the highly regarded Software Carpentry Foundation.

You'll learn:

  • The concept of structured data
  • The use of XPath queries on HTML document
  • How to scrape data using browser extensions
  • How to scrape using Python and Scrapy
  • How to automate the scraping of multiple web pages

Prerequisites:

A good knowledge of the basic concepts and techniques in Python. Consider taking our Learn to Program: Python and Python for Research courses to come up to speed beforehand.

For more information, please click here.

Start: Wednesday, 12 October 2022 @ 09:30

End: Thursday, 13 October 2022 @ 16:30

Timezone: Sydney

 Country: Australia

Eligibility:
  • Host institutions

Organiser: Intersect Australia

Contact: training@intersect.org.au

Host institution: UC

Collecting Web Data at UC Online https://dresa.org.au/events/collecting-web-data-at-uc-online-1abf7b55-140d-4eea-a38c-22d682f9ebc5 Web scraping is a technique for extracting information from websites. This can be done manually but it is usually faster, more efficient and less error-prone if it can be automated. Web scraping allows you to convert non-tabular or poorly structured data into a usable, structured format, such as a .csv file or spreadsheet. But scraping is about more than just acquiring data: it can help you track changes to data online, and help you archive data. In short, it's a skill worth learning. So join us for this web scraping workshop to learn web scraping, using the researcher-focused training modules from the highly regarded Software Carpentry Foundation. #### You'll learn: - The concept of structured data - The use of XPath queries on HTML document - How to scrape data using browser extensions - How to scrape using Python and Scrapy - How to automate the scraping of multiple web pages #### Prerequisites: A good knowledge of the basic concepts and techniques in Python. Consider taking our [Learn to Program: Python](https://intersect.org.au/training/course/python101/) and [Python for Research](https://intersect.org.au/training/course/python110/) courses to come up to speed beforehand. **For more information, please click [here](https://intersect.org.au/training/course/webdata201).** 2022-10-12 09:30:00 UTC 2022-10-13 16:30:00 UTC Intersect Australia Australia Australia UC training@intersect.org.au [] [] [] host_institution []