Building a Web Scraping Tool with Scrapy: Custom Pipelines, Settings, and Selectors

Опубликовано: 21 Март 2025
на канале: Byron Codes
125
6

In this tutorial, we build a scrapy application that scrapes an online marketplace for the current Top Deals.

You will learn the basics of setting up a scrapy application, custom pipelines, custom settings, and downloading data to an SQLite database.

GitHub repo - https://github.com/MandelaByron/jumia...

0:00 Intro
1:14 Virtual environment
2:55 scrapy setup
6:13 XPath selectors
22:56 Scrapy Follow URL
29:04 Custom Settings
32:10 Scrapy Items
34:51 Scrapy Pipelines
38:50 SQLite