In this video, we'll learn how to do Mistral 7B function calling using llama.cpp. And it works much better than my experiments with Ollama.
#llms #mistralai #llamacpp
Blog - https://www.markhneedham.com/blog/2024/06/23/mistral-7b-function-calling-llama-cpp/
Model Downloader - https://github.com/bodaay/HuggingFaceModelDownloader
llama.cpp Python - https://llama-cpp-python.readthedocs.io/en/latest/
Mistral 7B v3 - https://huggingface.co/MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF
Download
0 formats
No download links available.
Mistral 7B Function Calling with llama.cpp | NatokHD