LocalGPT Updates - Tips & Tricks

In this video, we will look at all the exciting updates to the LocalGPT project that lets you chat with your documents. The new updates include support for GGUF format model with llama cpp, better prompt template for restricting answering using Llama-2 template and a lot more! If you like the repo, don't forget to give it a ⭐ 💻 Pre-configured localGPT VM: https://bit.ly/localGPT (use Code: PromptEngineering for 50% off). ▬▬▬▬▬▬▬▬▬▬▬▬▬▬ CONNECT ▬▬▬▬▬▬▬▬▬▬▬ ☕ Buy me a Coffee: https://ko-fi.com/promptengineering |🔴 Support my work on Patreon: Patreon.com/PromptEngineering 🦾 Discord: https://discord.com/invite/t4eYQRUcXB ▶️️ Subscribe: https://www.youtube.com/@engineerprompt?sub_confirmation=1 📧 Business Contact: [email protected] 💼Consulting: https://calendly.com/engineerprompt/consulting-call 💻 Pre-configured localGPT VM: https://bit.ly/localGPT (use Code: PromptEngineering for 50% off). ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ LINKS: Github Link: https://github.com/PromtEngineer/localGPT LocalGPT- Detailed walkthrough: https://youtu.be/MlyoObdIHyo LocalGPT with Llama2: https://youtu.be/lbFmceo4D5E LocalGPT with Memory: https://youtu.be/KBrT0czrtAs ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ Timestamps: [00:00] Intro [00:54] LlamaCpp with GPU [04:54] GPU VRAM Required for LLMs [06:33] Which LLMs are supported [07:00] Adding Documents to Vector Store [08:08] Chatting with Documents [11:25] Limit Answers to the given context [14:18] Where are the models downloaded. [15:23] Define Context Window [16:00] Change N_GPU_layers [16:22] Change the Embedding model [16:50] Change the LLM All Interesting Videos: Everything LangChain: https://www.youtube.com/playlist?list=PLVEEucA9MYhOu89CX8H3MBZqayTbcCTMr Everything LLM: https://youtube.com/playlist?list=PLVEEucA9MYhNF5-zeb4Iw2Nl1OKTH-Txw Everything Midjourney: https://youtube.com/playlist?list=PLVEEucA9MYhMdrdHZtFeEebl20LPkaSmw AI Image Generation: https://youtube.com/playlist?list=PLVEEucA9MYhPVgYazU5hx6emMXtargd4z