gptq quantization explained

Unknown Channel

Unknown Channel666 subscribers

Oct 27, 2024

Download

0 formats

No download links available.

Related Videos

20

Understanding int8 neural network quantization

Oscar Savolainen

49.0K views · 2 years ago

Which Quantization Method is Right for You (GPTQ vs. GGUF vs. AWQ)

Maarten Grootendorst

39.0K views · 2 years ago

Quantization explained with PyTorch - Post-Training Quantization, Quantization-Aware Training

Umar Jamil

53.0K views · 2 years ago

The Most Important Algorithm in Machine Learning

Artem Kirsanov

1.0M views · 2 years ago

Self-Attention Explained How Transformers Actually Work (Full Visual Breakdown)

Visual AI

27.0K views · 2 weeks ago

AWQ Activation-aware Weight Quantization for LLM Compression and Acceleration [MLSys'24 Best Paper]

MIT HAN Lab

46.0K views · 1 year ago

Quantizing LLMs - How & Why (8-Bit, 4-Bit, GGUF & More)

Adam Lucek

25.0K views · 1 year ago

Quantization vs Pruning vs Distillation Optimizing NNs for Inference

Efficient NLP

64.0K views · 2 years ago

How to Quantize a ResNet from Scratch! Full Coding Tutorial (Eager Mode)

Oscar Savolainen

22.0K views · 2 years ago

Transformers, the tech behind LLMs Deep Learning Chapter 5

3Blue1Brown

10.0M views · 2 years ago

The Strange Math That Predicts (Almost) Anything

Veritasium

11.0M views · 9 months ago

Lecture 7 Advanced Quantization

GPU MODE

62.0K views · 2 years ago

LLM Fine-Tuning 12 LLM Quantization Explained( PART 1) PTQ, QAT, GPTQ, AWQ, GGUF, GGML, llama.cpp

Sunny Savita

77.0K views · 8 months ago

Optimize Your AI - Quantization Explained

Matt Williams

464.0K views · 1 year ago

How to statically quantize a PyTorch model (Eager mode)

Oscar Savolainen

31.0K views · 2 years ago

Andrej Karpathy From Vibe Coding to Agentic Engineering

Sequoia Capital

805.0K views · 1 week ago

They Lied to You About AI (This Study Proves It)

Caleb Ulku

275.0K views · 1 month ago

QuIP 2-Bit Quantization for LLMs

hu-po

25.0K views · 2 years ago

LLaMa GPTQ 4-Bit Quantization. Billions of Parameters Made Smaller and Smarter. How Does it Work

AemonAlgiz

29.0K views · 2 years ago

How AI Cracked the Protein Folding Code and Won a Nobel Prize

Quanta Magazine

632.0K views · 1 year ago

© 2026 NatokHD. Not affiliated with YouTube.

About Terms Contact

gptq quantization explained | NatokHD