Systematic evaluation is the key piece in taking your RAG-systems from just a cool demo into something that's actually useful for real people and businesses.
In this video, I show you how to get started using TruLens, an evaluation framework for this exact purpose. TruLens has been developed by TruEra, a well-established ML-monitoring company.
▬▬▬▬▬▬ LINKS ▬▬▬▬▬▬
Connect with me on LinkedIn:
https://www.linkedin.com/in/johannesjolkkonen/
https://github.com/JohannesJolkkonen/gettingdata-samples
▬▬▬▬▬▬ T I M E S T A M P S ▬▬▬▬▬▬
0:00 - Intro
3:32 - Tutorial starts
7:20 - Configuring TruLens
9:15 - Defining evaluation metrics
20:31 - Why I like LlamaIndex
22:42 - Visualize the results
24:49 - Optimizing RAG-performance
29:55 - Measuring improvement
31:11 - TruLens with your custom RAG
