API For Open-Source Models 🔥 Easily Build With ANY Open-Source LLM
In this video, we review OpenLLM, and I show you how to install and use it. OpenLLM makes building on top of open-source models (llama, vicuna, falcon, opt, etc) as easy as it is to build on top of ChatGPT's API. This allows developers to create incredible apps on top of open-source LLMs while having first-class support for tools (langchain, hugging face agents bentoML), and one-click deployment. Also, fine-tuning is coming soon!
Enjoy :)
Join My Newsletter for Regular AI Updates 👇🏼
https://www.matthewberman.com
Need AI Consulting? ✅
https://forwardfuture.ai/
Rent a GPU (MassedCompute) 🚀
https://bit.ly/matthew-berman-youtube
USE CODE "MatthewBerman" for 50% discount
My Links 🔗
👉🏻 Subscribe: / @matthew_berman
👉🏻 Twitter: / matthewberman
👉🏻 Discord: / discord
👉🏻 Patreon: / matthewberman
Media/Sponsorship Inquiries 📈
https://bit.ly/44TC45V
Links:
OpenLLM Github - https://github.com/bentoml/OpenLLM
