How do I merge multiple LLMs and create a better one out of them without any training? Or can I? This video answers these questions with a quick tutorial. Enjoy. GitHub below ↓
Want to support the channel? Hit that like button and subscribe!
GitHub Link of the Code
https://github.com/uygarkurt/Model-Merge
Mergekit
https://github.com/arcee-ai/mergekit
Julien Simon Explanation
https://www.youtube.com/watch?v=cvOpX75Kz4M&t=2028s
My Merged Model
https://huggingface.co/uygarkurt/llama-3-merged-linear
00:00 Introduction
02:09 Installation
02:50 Merge Configuration
04:46 Merge LLM Models
07:36 Experiment Merged Model
10:35 Push Model to HuggingFace
11:38 Submit to Open LLM Leaderboard
Buy me a coffee! ☕️
https://ko-fi.com/uygarkurt
Download
0 formats
No download links available.
Model Merging: Merge LLMs to Create Frankestein Models - Python, HuggingFace, Mergekit | NatokHD