How To Load One BILLION Rows into an SQL Database
📝 Get my free SQL Cheat Sheets: https://www.databasestar.com/get-sql-...
🎓 Master SQL Fundamentals: https://databasestar.mykajabi.com/sql...
Have you ever wondered how to import one billion rows into an SQL database? Or how long it would take?
In this video, you'll see how to generate a file with 1 billion rows, how to import it into four different SQL databases, and how long it takes in each database.
⏱ TIMESTAMPS:
00:00 - The challenge
00:31 - Setting up the data
02:08 - MySQL
04:08 - Postgres
05:31 - SQL Server
07:35 - Oracle method 1
09:33 - Oracle method 2
🔗 VIDEO LINKS:
Gunnar Morling's blog post: https://www.morling.dev/blog/one-bill...
1BRC GitHub repo: https://github.com/gunnarmorling/1brc
SQL scripts used in this video: https://github.com/bbrumm/databasesta...
Commands to clone the repo and generate the file:
git clone https://github.com/gunnarmorling/1brc...
java -version
mvnw verify
sh create_measurements.sh 1000000000
Specs of the computer used in this video:
Lenovo Ideapad 5 laptop
CPU: Intel i5 2.4 GHz
RAM: 16 GB
OS: Windows 11
