Back to Browse

Mistral 7B Function Calling with llama.cpp

4.8K views
Jun 23, 2024
5:18

In this video, we'll learn how to do Mistral 7B function calling using llama.cpp. And it works much better than my experiments with Ollama. #llms #mistralai #llamacpp Blog - https://www.markhneedham.com/blog/2024/06/23/mistral-7b-function-calling-llama-cpp/ Model Downloader - https://github.com/bodaay/HuggingFaceModelDownloader llama.cpp Python - https://llama-cpp-python.readthedocs.io/en/latest/ Mistral 7B v3 - https://huggingface.co/MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Download

0 formats

No download links available.

Mistral 7B Function Calling with llama.cpp | NatokHD