The REAL cost of LLM (And How to reduce 78%+ of Cost)

Опубликовано: 30 Январь 2025
на канале: AI Jason

93,206

3.6k

I want to give you step by step guide on how to reduce LLM cost by 70%, and unpack why it is costing so much now

Get free HubSpot AI For Marketers Course: https://clickhubspot.com/xut

🔗 Links
Join my community: https://www.skool.com/ai-builder-club...
Follow me on twitter:   / jasonzhou1993
Join my AI email list: https://crafters.ai/
My discord:   / discord
Inbox Agent:    • After 7 days letting AI agents contro...
Research Agent:    • "Wait..this AI Agent does research fo...
James Brigg on Agent Memory: https://www.pinecone.io/learn/series/...
Another video about details for LLM cost tracking:    • How to reduce LLM costs. And a usage ...

⏱️ Timestamps
0:00 How I burned $5000 on OpenAI
2:41 My experience with AI Girlfriend Project
6:01 HubSpot AI For Markter
7:23 How to Reduce LLM Cost
8:33 Method 1 - Finetune
9:51 Method 2 - Cascade
10:35 Method 3 - LLM Router
12:47 Method 4 - Multi-Agent
14:07 Method 5 - LLMLingua
16:31 Method 6 - Optimise tool input/output
17:16 Method 7 - Memory Optimisation
19:26 LLM Monitor & Analytics
20:09 Tutorial: Monitor & reduce 75% cost

👋🏻 About Me
My name is Jason Zhou, a product designer who shares interesting AI experiments & products. Email me if you need help building AI apps! [email protected]

#mixtral #gpt4turbo #gpt4 #ai #artificialintelligence #tutorial #stepbystep #openai #llm #chatgpt #largelanguagemodels #largelanguagemodel #bestaiagent #chatgpt #agentgpt #agent #autogen #autogpt