Code a Python Bot (Part 4: Scraping data to a Pandas Data frame)

Опубликовано: 09 Октябрь 2024
на канале: CODE MENTAL

316

#python #pythonbot #webscraping #pandas #selenium

In this series, I will show you how to code a Python Bot by example. Follow me as I develop from scratch a Python bot that is able to find suitable clubs to play badminton in my local area of London.

⭐ DON'T KNOW PYTHON?

Python for Everybody 👉🏼 https://coursera.pxf.io/mgJKke

Note: I will get an affiliate commission if you sign up for the course. So that's one way for you to support the channel.

✅ Source Code and Article:

https://spltech.co.uk/how-to-make-a-p...

✅ CONTACT ME FOR CONSULTING AND ANY OTHER BUSINESS ENQUIRIES

[email protected]

✅ SUPPORT THE CHANNEL or get MENTORING

/ codemental

✅ FOLLOW ME

Instagram: / codemental
Blog: https://spltech.co.uk/blog/

✅ My Equipment

If you are curious about what equipment I use and you want to support the channel, feel free to check my affiliate links. This means that, at zero cost to you, I will earn an affiliate commission if you click through the link and finalize a purchase.

Samsung 970 Evo Plus SSD 2TB - M.2
US: https://amzn.to/3FwhxrR
UK: https://amzn.to/3cAsKv3

COMPONENTS FOR RTX 3090 DEEP LEARNING PC COMPONENTS(Affiliate Links)

AMD Ryzen 5900X CPU
US: https://amzn.to/3c1Iubi
UK: https://amzn.to/2KDY0ih

ASUS TUF Gaming NVIDIA GeForce RTX 3060 OC Edition Graphics Card, 12GB GDDR6
US: https://amzn.to/3xgZ6nb
UK: https://amzn.to/3xdR2Up

EVGA GeForce RTX 3090 Ultra Gaming, 24GB GDDR6X, ARGB LED, Metal Backplate, 24G
US: https://amzn.to/3dFS7MK
UK: https://amzn.to/36boAGA

ASUS ROG Strix X570-E Gaming ATX Motherboard, AMD Socket AM4
US: https://amzn.to/3oa9tnB
UK: https://amzn.to/3iAHtrU

Corsair iCUE H150i PRO XT RGB Liquid CPU Cooler (360mm)
US: https://amzn.to/2LYCFRp
UK: https://amzn.to/2Y1DCuG

NZXT Kraken Z73 360mm AIO LIquid Cooler RGB CPU
US: https://amzn.to/3qFUQeC
UK: https://amzn.to/2UlnDc4

Crucial Solid State Drive 1TB
UK: https://amzn.to/2KP797W
US: https://amzn.to/39X8xhf

Samsung 970 Evo Plus SSD 1TB - M.2
US: https://amzn.to/3w8rgQ5
UK: https://amzn.to/36aKY36

PC Case - Phanteks Eclipse P600S
US: https://amzn.to/3c3sEgn
UK: https://amzn.to/2LNARL7

Memory - Corsair Vengeance RGB Pro 32GB (2x16GB) DDR4 3600- Black
US: https://amzn.to/3c1PuVC
UK: https://amzn.to/2Y5mJzm

Corsair RM850, RM Series, 80 Plus Gold Certified, 850 W Fully-Modular ATX Power Supply
US: https://amzn.to/2UhULl5
UK: https://amzn.to/3yhdjR5

SAMSUNG 34-Inch CJ791 Ultrawide Curved Gaming Monitor, White
US: https://amzn.to/2TnVaCE
UK: https://amzn.to/3ymJgYv

Logitech K780 Multi-Device Wireless Keyboard
US: https://amzn.to/3hvjFWn
UK: https://amzn.to/3ht4Ymz

Timestamps

0:00 Pandas Library
1:30 Understanding HTML Structure for Scraping
3:15 Importing BeautifulSoup library
3:45 Feeding HTML from selenium to BeautifulSoup
4:00 Finding div by css class with BeautifulSoup with findAll() method
5:45 Extracting text from HTML using BeautifulSoup
6:45 Finding div by css class with BeautifulSoup find() method
9:25 Retrieving date from date picker using xpath