In this video I am going to deploy the yesterday released Llama-3.2-11B-Vision Instruct multimodal Model on a Runpod GPU-VPS using LitServe.
If you run into issues with the GPU size, please go with more VRAM.
Make sure to checkout https://finetunefast.com to get exclusive access to the FinetuneFast repository.
Runpod (affiliate link): https://runpod.io?ref=dcdwr5q2
Code: https://gist.github.com/grumpyp/d73fd...