File-based Postgres Analytics with DuckDB and AWS S3
DuckDB is the SQLite of Analytics. In this video, Tyler Hillery demonstrates how to use DuckDB to store the result of a PostgreSQL query in Parquet files within an AWS S3 bucket. These are automatically synchronized to Supabase Storage.
GitHub Repo: https://github.com/TylerHillery/supab...
00:00 File-based Postgres Database Analytics with DuckDB and AWS S3
01:26 Declaring Environment Variables for Supabase Storage
05:20 Configuring Python project
07:44 Query data from Postgres DB using DuckDB
09:20 Export Postgres query as Parquet file and store in AWS S3 bucket
12:20 Query Supabase Storage with Duck DB
13:30 Joining Parquet files for advanced analytics
14:28 Different output formats to integrate with third party analytics tools
💻 Videos to watch next:
▶ Supabase is now GA: • Supabase is now GA
▶ A new way to use Supabase Storage: • A new way to use Supabase Storage
▶ Improve UX with Anonymous Sign-Ins: • Improve UX with Anonymous Sign-Ins
👇 Learn more about Supabase 👇
🕸 Website: https://supabase.com/
🏁 Get started: https://app.supabase.com/
📄 Docs: https://supabase.com/docs
🔔 Subscribe for more tutorials and feature updates from Supabase: / @supabase
📱 Connect with Us:
🐙 Github: https://github.com/supabase
💬 Discord: https://discord.supabase.com/
🐦 Twitter: / supabase
📸 Instagram (follow for memes): / supabasecom
ABOUT SUPABASE:
Supabase is the open source Firebase alternative. Supabase provides a full Postgres database for every project with pgvector, backups, realtime, and more. Add and manage email and password, passwordless, OAuth, and mobile logins to your project through a suite of identity providers and APIs.
Build in a weekend, scale to millions.
#Supabase #AppDevelopment #RealtimeApps #DeveloperTools
