How To Run ANY Open Source LLM LOCALLY In Linux

Опубликовано: 17 Январь 2025
на канале: Ksk Royal

5,809

179

In this video, I will show you how to run ANY open source llm (large language models) locally on Linux using Ollama & LMStudio. Ollama & LMStudio are the best tools that allows you to run various models such as llama3, Gemma, Mistral, codellama & much more. Watch this video and learn running LLMS locally on Linux computer.

Timestamps
00:00 Introduction
00:38 Pre-requisites
01:16 Installing Ollama
02:18 Download LLM
03:01 Testing LLAMA3 & Gemma
05:31 Customizing Model
06:55 Installing LMStudio

Download
Ollama: https://ollama.com/download
LMStudio: https://lmstudio.ai/

Relevant Tech Videos
Dual boot ubuntu 24.04 LTS And Windows 11 -    • How to Dual Boot Ubuntu 24.04 LTS and...
Clean Install Ubuntu 24.04 LTS -    • How TO Install Ubuntu 24.04 LTS EASIL...
Install Ubuntu 24.04 LTS On Virtual Box -   • How To Install Ubuntu 24.04 LTS in Vi...

~ Buy Me A Coffee - http://buymeacoffee.com/kskroyal
~ Connect On Instagram - @KSKROYALTECH
~ For Business Enquires ONLY - [email protected]
~ My Website - https://kskroyal.com/

© KSK ROYAL
MereSai