Scraping the Web with Ruby - Part 7 (2020)

Опубликовано: 16 Октябрь 2024
на канале: Techmaker Studio

454

Scraping the web with Ruby is a really interesting exercise if you're learning to code. We'll do a deep dive into how you can parse raw HTML from websites and extract useful data that you can use for all sorts of things.

HELPFUL RESOURCES:

FREE SaaS-in-a-Box Codebase: https://hi.cst.work/603931

Book: The Well-Grounded Rubyist
Link: https://amzn.to/2H2QhGj
By: David A. Black

Reading "The Well-Grounded Rubyist" is one of the best ways to develop a deep, professional level of understanding of the Ruby programming languages. It was one of the first Ruby books that I read, and it helped me move well beyond the "beginner phase". Highly recommended.

Book: Practical Object Oriented Design in Ruby
Link: https://amzn.to/2EtnGII
By: Sandi Metz

I attended a workshop with Sandi Metz a couple of years ago, and it totally changed the way that I think about programming. This book is a must read for anyone serious about building real applications.

SERIES DESCRIPTION:

This video series is going to explore how you can scrape information from websites using a variety of methods in the Ruby programming language. It will make heavy use of native string parsing and searching as well as some popular gems like Nokogiri.

We will start by looking at how to pull information back from any typical website, and we will move on to more advanced functionality like parsing information into objects, storing the records in a database, and displaying some basic statistics.

Website scraping is not an exact science. Since websites frequently change their interfaces, you cannot depend on code that you write to work all of the time. Additionally, some websites state that scraping is not allowed in their terms of service. Most people never read all of the terms of service, and it's not practical to do so with every site you interact with. That said, if you intend to use anything in this series beyond your own personal research and education, you'd benefit from investigating any legal issues.