In our last lesson we scraped the whole website up to the last book. But today, we are going to learn a tool that is going to make our Web Scraping tasks even easier.
We are talking about the CrawlSpider.
In this video you will learn how to:
How to use the new spider: CrawlSpider
What Rules and LinkExtractor are
Scrape the whole website without effort
---------------------------------
Timestamps:
00:44 - Gameplan
01:32 - CrawlSpider
03:20 - Rules and LinkExtractor
06:47 - Filtering URLs
09:52 - Conclusion
10:49 - Exercise
---------------------------------
Subscribe to the channel:
/ @letslearnabout4934
Text version:
https://letslearnabout.net/tutorial/p...
Twitter:
/ davidmm1707
GitHub:
https://github.com/david1707