Mozilla Llamafile in Supabase Edge Functions
Today we are adding @Mozilla Llamafile, in addition to Ollama, to be used as the Inference Server with your @Supabase Edge Functions.
Mozilla Llamafile lets you distribute and run LLMs with a single file that runs locally on most computers, with no installation! In addition to a local web UI chat server, Llamafile also provides an OpenAI API compatible server, that is now integrated with Supabase Edge Functions.
Read the tutorial 👉 https://supabase.link/llamafile-blog
CHAPTERS:
00:00 Intro
00:21 Recap to AI in Supabase Edge Functions Launch
00:48 Support for Llamafile in Supabase Edge Functions
01:05 Download a Llamafile from GitHub
01:33 Run a Llamafile
01:53 Interact with the Llamafile chat interface in the Browser
02:25 Llamafile OpenAI compatible API
02:50 Use Llamafile within Supabase Edge Functions
03:50 Set the API Host environment variable
04:00 Dockerize a LLamafile for remote hosting
04:50 Run the Supabase Edge Function locally
05:39 Handling streaming responses
06:50 Use Llalamfile with the OpenAI JavaScript SDK
💻 Videos to watch next:
▶ • Realtime AI in the Browser
▶ • I gave AI full control over my databa...
▶ • Using Claude 3.5 Sonnet and Supabase ...
👇 Learn more about Supabase 👇
🕸 Website: https://supabase.com/
🏁 Get started: https://app.supabase.com/
📄 Docs: https://supabase.com/docs
🔔 Subscribe for more tutorials and feature updates from Supabase: / @supabase
📱 Connect with Us:
🐙 Github: https://www.github.com/supabase
💬 Discord: https://discord.supabase.com/
🐦 Twitter: / supabase
▶ Instagram (follow for memes): / supabasecom
ABOUT SUPABASE:
Supabase is the open source Firebase alternative. Supabase provides a full Postgres database for every project with pgvector, backups, realtime, and more. Add and manage email and password, passwordless, OAuth, and mobile logins to your project through a suite of identity providers and APIs.
Build in a weekend, scale to millions.
#Supabase #AppDevelopment #RealtimeApps #DeveloperTools #llm #openai #llamafile #mozilla #ai
