Learn Web Scraping by Scraping Reddit Activity Pt 2 | Cron Scheduling

Опубликовано: 29 Сентябрь 2024
на канале: Smoljames
377
18

In this video we learn how to schedule web scraping jobs to occur at regular intervals using a CRON schedular. We also look at how we can persist this data in a JSON database. Part 3 will look at how we can serve our data up as a RESTful JSON API.

#Node.js #CRON #Webscraping

🔗 Resources

Part 1 -    • Learn Web Scraping by Scraping Reddit...  
Part 2 -    • Learn Web Scraping by Scraping Reddit...  
Part 3 -    • Learn Web Scraping by Scraping Reddit...  
Github repository - https://github.com/jamezmca/reddit-re...

🔥 Get More Content - Subscribe and turn on notifications to stay tuned for new videos in my 'Land a dev job' series!

📚 Chapters

00:00 CRON job scheduler
02:19 Persist data in an object
05:20 Persist data in a JSON database

🔖 Topics Covered

- How to schedule web scraping jobs
- Run code at regular intervals
- Save data in a JSON database