what is llm quantization

Unknown Channel

Unknown Channel11.1K subscribers

Mar 19, 2025

Download

0 formats

No download links available.

Related Videos

20

How LLMs survive in low precision Quantization Fundamentals

Julia Turc

54.0K views · 11 months ago

Does LLM Size Matter How Many Billions of Parameters do you REALLY Need

Gary Explains

46.0K views · 1 year ago

Quantizing LLMs - How & Why (8-Bit, 4-Bit, GGUF & More)

Adam Lucek

25.0K views · 1 year ago

LoRA & QLoRA Fine-tuning Explained In-Depth

Mark Hennings

164.0K views · 2 years ago

KV Cache The Invisible Trick Behind Every LLM

Adam Rosler

16.0K views · 1 week ago

What Is Llama.cpp The LLM Inference Engine for Local AI

IBM Technology

141.0K views · 1 month ago

What are LLM Scaling Laws

New Machina

33.0K views · 1 year ago

Deep Dive Quantizing Large Language Models, part 1

Julien Simon

23.0K views · 2 years ago

Visualizing transformers and attention Talk for TNG Big Tech Day '24

Grant Sanderson

12.0M views · 1 year ago

DeepSeek Gave LLMs a Real Memory (It's Not RAG)

Jia-Bin Huang

54.0K views · 1 month ago

Transformers, the tech behind LLMs Deep Learning Chapter 5

3Blue1Brown

10.0M views · 2 years ago

AI Inference The Secret to AI's Superpowers

IBM Technology

132.0K views · 1 year ago

5. Comparing Quantizations of the Same Model - Ollama Course

Matt Williams

31.0K views · 1 year ago

LLM Fine-Tuning 12 LLM Quantization Explained( PART 1) PTQ, QAT, GPTQ, AWQ, GGUF, GGML, llama.cpp

Sunny Savita

77.0K views · 8 months ago

Why Inference is hard..

Caleb Writes Code

138.0K views · 3 weeks ago

What is LoRA Low-Rank Adaptation for finetuning LLMs EXPLAINED

AI Coffee Break with Letitia

100.0K views · 2 years ago

Run AI Models on Your PC Best Quantization Levels (Q2, Q3, Q4) Explained!

GosuCoder

55.0K views · 1 year ago

Which Quantization Method is Right for You (GPTQ vs. GGUF vs. AWQ)

Maarten Grootendorst

39.0K views · 2 years ago

Quantization explained with PyTorch - Post-Training Quantization, Quantization-Aware Training

Umar Jamil

54.0K views · 2 years ago

Quantization vs Pruning vs Distillation Optimizing NNs for Inference

Efficient NLP

64.0K views · 2 years ago

© 2026 NatokHD. Not affiliated with YouTube.

About Terms Contact

what is llm quantization | NatokHD