Extract all the data! - 02 - Python scrapy tutorial for beginners
In our last lesson, we have created our first Scrapy spider and we have scraped a few fields from the book. But we also learnt that every item has a URL with more detailed data. Let’s see how to extract all the data in different ways.
In this post you will learn how to:
Scrap items on their own page
Extract routes with relative URLs
Select elements by tag, class, partial class and siblings elements
Extract information from tables
Use callbacks to other Scrapy class methods
---------------------------------
Timestamps:
00:38 - Gameplan
01:00 - Creating a new method
03:25 - Extracting the first elements
06:45 - The 'contains' selector
12:34 - The 'following-sibling' selector
14:04 - Selecting tables
16:56 - Conclusion
---------------------------------
Related videos:
Beautiful Soup - 01 - Your first Web Scraping script with Python
• Beautiful Soup - 01 - Your first Web ...
Creating your first Scrapy spider - 01 - Python scrapy tutorial for beginners
• Creating your first Scrapy spider - 0...
---------------------------------
Subscribe to the channel:
/ @letslearnabout4934
Text version:
https://letslearnabout.net/tutorial/s...
Twitter:
/ davidmm1707
GitHub:
https://github.com/david1707
