In this video we learn how to schedule web scraping jobs to occur at regular intervals using a CRON schedular. We also look at how we can persist this data in a JSON database. Part 3 will look at how we can serve our data up as a RESTful JSON API.
#Node.js #CRON #Webscraping
🔗 Resources
Part 1 - • Learn Web Scraping by Scraping Reddit...
Part 2 - • Learn Web Scraping by Scraping Reddit...
Part 3 - • Learn Web Scraping by Scraping Reddit...
Github repository - https://github.com/jamezmca/reddit-re...
🔥 Get More Content - Subscribe and turn on notifications to stay tuned for new videos in my 'Land a dev job' series!
📚 Chapters
00:00 CRON job scheduler
02:19 Persist data in an object
05:20 Persist data in a JSON database
🔖 Topics Covered
- How to schedule web scraping jobs
- Run code at regular intervals
- Save data in a JSON database