quantization in llm

Unknown Channel

Unknown Channel13K subscribers

Dec 12, 2024

Download

0 formats

No download links available.

Related Videos

20

Quantizing LLMs - How & Why (8-Bit, 4-Bit, GGUF & More)

Adam Lucek

25.0K views · 1 year ago

The Era of 1-bit LLMs All Large Language Models are in 1.58 Bits and BitNet

Gabriel Mongaras

63.0K views · 2 years ago

Software Engieering Expectations 2026

Stephen Blum

77 views · 1 day ago

Quantization explained with PyTorch - Post-Training Quantization, Quantization-Aware Training

Umar Jamil

54.0K views · 2 years ago

The myth of 1-bit LLMs Quantization-Aware Training

Julia Turc

93.0K views · 11 months ago

Which Quantization Method is Right for You (GPTQ vs. GGUF vs. AWQ)

Maarten Grootendorst

39.0K views · 2 years ago

Your Local LLM Is 3x Slower Than It Should Be

Alex Ziskind

93.0K views · 2 months ago

Optimizing vLLM Performance through Quantization Ray Summit 2024

Anyscale

29.0K views · 1 year ago

The Era of 1-bit LLMs-All Large Language Models are in 1.58 Bits

Krish Naik

61.0K views · 2 years ago

LoRA & QLoRA Fine-tuning Explained In-Depth

Mark Hennings

164.0K views · 2 years ago

The Strange Math That Predicts (Almost) Anything

Veritasium

11.0M views · 9 months ago

AWQ Activation-aware Weight Quantization for LLM Compression and Acceleration [MLSys'24 Best Paper]

MIT HAN Lab

46.0K views · 1 year ago

The Most Controversial Idea In Math

Veritasium

14.0M views · 1 year ago

Llama3 Comparing 8B vs 70B Parameter Models - Which One is Right for You

Compute Grid

15.0K views · 1 year ago

Quantization vs Pruning vs Distillation Optimizing NNs for Inference

Efficient NLP

64.0K views · 2 years ago

This Tiny 1-Bit Model Could Change AI Forever

Better Stack

25.0K views · 8 months ago

5. Comparing Quantizations of the Same Model - Ollama Course

Matt Williams

31.0K views · 1 year ago

Why I Left Quantum Computing Research

Looking Glass Universe

13.0M views · 10 months ago

AWQ for LLM Quantization

MIT HAN Lab

12.0K views · 2 years ago

What is LLM Quantization

New Machina

34.0K views · 1 year ago

© 2026 NatokHD. Not affiliated with YouTube.

About Terms Contact

quantization in llm | NatokHD