Scraping Data with an ESP8266 or an ESP32

Опубликовано: 04 Январь 2025
на канале: Brian Lough
20,876
506

Have you ever wanted to get data for your project, but there is no public API for it or cases like the Instagram API where the setup process for the is not very convenient? Well in this video we are going to look at 2 different options for scraping data from a website for your ESP8266 or ESP32 projects.


We'll look at Non-Public APIs and scraping the data directly.

---------------------------------
Info Links:
---------------------------------

Arduino sample request: https://github.com/witnessmenow/ardui...


Previous Video on API:    • Connecting to an API using an ESP8266...  


Team Trees code: https://github.com/witnessmenow/TeamT...


Crowdsupply NodeJS scraper: https://github.com/witnessmenow/crowd...



---------------------------------
My Discord:
---------------------------------

Come hang out and talk about this video or any project you are working on!

  / discord  

---------------------------------
Github Sponsorship:
---------------------------------

I have set up a Github Sponsorship page, it's similar style thing to patreon, but Github are offering to match all sponsorships for the first year! (you sponsor $2, I receive $4)

https://github.com/sponsors/witnessme...

Some people have said they would prefer a once off way of supporting the channel, here is a Paypal link if you would prefer that!

https://www.paypal.me/bloughyt




---------------------------------
My Tindie Store:
---------------------------------

I've started to sell stuff on Tindie, check it out!

https://www.tindie.com/stores/brianlo...

---------------------------------
Other Platforms:
---------------------------------
Twitter: @witnessmenow -   / witnessmenow  
Instagram -   / brian_lough  
Instructables: witnessmenow - https://www.instructables.com/member/...

---------------------------------
Support the Channel:
---------------------------------

If you would like to support the channel, here are some ways you can.

1 - Like and comment on the videos - I really like hearing from you and apparently it helps!

2 - Share my videos - If you know somewhere that might be interested in my channel, please share it!

3 - Affiliate links - Where I get a small percentage of the purchase price but doesn't cost you anything extra.

Amazon.co.uk: http://amzn.to/2g7mJIO
Amazon.com : http://amzn.to/2ykDQ42
Amazon.de: https://amzn.to/2WMq7vF

Aliexpress: http://s.click.aliexpress.com/e/wdhojba

LCSC (where I buy most of my parts for Tindie stuff): https://lcsc.com/?promote=ODM5ZTB5Nlk...

4 - My Amazon "store" - Really it's just a collection of stuff I use that I think are useful

https://www.amazon.co.uk/shop/brianlough

5 - Check out my Tindie Store

https://www.tindie.com/stores/brianlo...

---------------------------------
My Tools & Kit*:
---------------------------------

Ender 3 Pro 3d Printer - I got one of these recently and I love it!
UK : https://amzn.to/31bebXT
US : https://amzn.to/2IlSLid

Ts-100 Soldering Iron - I have this a couple of years and I love it, I thinking about getting a second!
UK : http://amzn.to/2nlOF23
US : http://amzn.to/2jDcyxl

Logitech C920 HD 1080p Pro webcam - I use one of these for my videos
UK: http://amzn.to/2pnxk9Z
US: http://amzn.to/2BsLMiF

Blue Snowball USB Microphone
UK: http://amzn.to/2C0x4TH
US: http://amzn.to/2DEA85J

Self Adjusting Wire Strippers
UK: http://amzn.to/2C0urkR
US: http://amzn.to/2BXQAh1

*= Affiliate Links