In this video, I explain how to run vLLM using Docker from scratch.
Tamil-based tutorial with full explanation.
⏱ Timestamps:
00:00 - Introduction
01:30 - What is Token?
02:18 - The Context Window?
03:32 - The Memory Problem
04:28 - PageAttendition
05:48 - Continous Batching
06:24 - The Speed Numbers
09:20 - Virtual Environment creation
10:34 - Docker Setup
🔗 Resources:
- vLLM GitHub: https://github.com/Gowthambalan/vllm_docker
- Docker Docs: https://docs.docker.com
🔔 Subscribe for more Tamil tech tutorials!
#vLLM #Docker #TamilTech #MachineLearning #LLM #AITutorial#Probotechy
Download
0 formats
No download links available.
Run vLLM using Docker – Complete Tamil Tutorial | Step by Step Guide | NatokHD