Easy 100% Local RAG Tutorial (DeepSeek-R1) + Full Code
📁 Get the Code: https://www.lukejbyrne.com/c/n8n-rag-...
🤖 Join the Applied AI Community! https://kickofflabs.com/waitlist/d362...
I'm building a Skool community with courses, templates, and live calls to help you learn and use AI.
💻 Beta Test my AI App for Developers! https://forms.gle/tZ3mFxHEScktUwfq8
Be one of the first to try out my new AI pet app! Sign up for beta access.
Description
In this video, I’ll show you how to run a completely private large language model on your own machine and use a vector database (ChromaDB) to chat with your documents—no API keys needed!
📌 What you'll learn:
✅ How to install and run an LLM locally
✅ How vector databases like ChromaDB work
✅ How to embed and search documents for chat-based retrieval
✅ How to set up a local AI assistant using Open Source tools
Try with APIs (Pinecone, Google Drive, etc.): • Code Your First DeepSeek RAG AI AGENT...
Try with n8n: • Create Your First DeepSeek RAG AI AGE...
Courses & Certificates
🏆 To continually upskill without the hassle of scrolling through YouTube, when wanting structured learning for Data and AI, I use DataCamp. Specifically, Premium - which gives you unlimited learning across all tracks with certificates at the end. Here are the courses I recommend.
👇 Check them out for free 👇
Artificial Intelligence
🤖 AI Fundamentals 👉 https://datacamp.pxf.io/vPZqkv
🏅 AI Leadership 👉 https://datacamp.pxf.io/Vx63kO
📊 AI Business Fundamentals 👉 https://datacamp.pxf.io/YRy3PP
🕹️ ChatGPT Fundamentals 👉 https://datacamp.pxf.io/MAN3zq
💬 OpenAI Fundamentals 👉 https://datacamp.pxf.io/aOWQoR
AI Engineering
🧑💻 AI Engineer Career Track 👉 https://datacamp.pxf.io/zx29Gr
⚙️ Machine Learning Engineer Career Track 👉 https://datacamp.pxf.io/nX2JxA
👾 Developing AI Applications 👉 https://datacamp.pxf.io/dO7jgj
🧠 Deep Learning in Python 👉 https://datacamp.pxf.io/Qj63Lo
🗣️ Developing Large Language Models 👉 https://datacamp.pxf.io/PO6NEe
🦜 Developing Applications with LangChain 👉 https://datacamp.pxf.io/Bn2o3y
Data Engineer
🌍 Understanding Data Engineering 👉 https://datacamp.pxf.io/JKq0ZE
🏅 Database Design 👉 https://datacamp.pxf.io/Xm1AEg
📊 Data Warehousing Concepts 👉 https://datacamp.pxf.io/WyYaPX
⚡ Introduction to dbt 👉 https://datacamp.pxf.io/09Y7BJ
🕹️ Introduction to Apache Airflow in Python 👉 https://datacamp.pxf.io/nXn3eX
📈 Introduction to NoSQL 👉 https://datacamp.pxf.io/6yG9RG
Cloud Engineer
🌤️ Understanding Cloud Computing 👉 https://datacamp.pxf.io/LKDqYY
1️⃣ Understanding Microsoft Azure 👉 https://datacamp.pxf.io/mOn3k1
2️⃣ AWS Concepts 👉 https://datacamp.pxf.io/7abrBQ
📊 Microsoft Azure Architecture and Services 👉 https://datacamp.pxf.io/MAQxYo
⚙️ Microsoft Azure Management and Governance 👉 https://datacamp.pxf.io/YRdGkj
🧩 AWS Cloud Technology and Services Concepts 👉 https://datacamp.pxf.io/4GdDBo
Social Media
📧 Newsletter: https://lukejbyrne.com/subscribe
📚 Linkedin: / lukejbyrne
Timestamps:
0:05 Intro: Local LLMs and Chatting with Documents
0:39 Code Structure: app.py and chat.py Overview
4:46 Requirements and Dependencies 5:20 Building the Application (app.py)
11:47 Virtual Environments and Package Management
15:10 Database Interactions: ChromaDB and SQLite
20:07 Sentence Transformer Model Setup
25:54 Document Processing: Files, Chunking, Metadata
34:24 Main App Function and Demo
38:20 Automation and Running the App
42:33 Chat Interface (chat.py) and Querying
48:36 Models, Parameters, and Running
52:18 Chat Agent and Demo
57:17 Troubleshooting, Performance, and Outro
Some links included are affiliate links, which help me keep this channel going. Thanks for the support.
Business inquiries: [email protected]
