How to Sync PostgreSQL Data w/ Airbyte
Want to build a reliable, modern data architecture without the mess?
Here’s a free checklist to help you → https://bit.ly/kds-checklist
One of the most common data sources in data architectures is a PostgreSQL database.
It might be the backend of an internal application or used by a third party tool.
Therefore, it's really important to be able to easily extract data from this source in an efficient way.
So in today's video, you're going to see how you can do this by setting up a Postgres connector using Airbyte.
We're going to cover:
Step by step how to configure it
Different options for extracting the data (ex. CDC)
Performance considerations when dealing with really large data sets
Enjoy!
Timestamps:
00:00 - Intro
00:35 - What is Airbyte?
01:32 - Configure PostgreSQL
02:46 - Setup Source Connector
04:39 - Enable Change Data Capture
07:34 - Create Connection to BigQuery
08:46 - Performance w/ Airbyte & PostgreSQL
10:03 - Review Results in BigQuery
Title & Tags:
How to Sync PostgreSQL Data w/ Airbyte
#kahandatasolutions #dataengineering #Airbyte
