In this video we explore the foundation of GenAI/LLM evaluation, tracing. Here we understand what a model trace is and how you can capture it simply with MLflow.
Video Resources
- Notebook Code: https://github.com/RamVegiraju/databricks-samples/tree/master/mlflow/GenAI-Evals
- MLFlow Tracing: https://docs.databricks.com/aws/en/mlflow3/genai/tracing
Timestamps
0:00 Introduction
1:30 GenAI Eval Challenges
5:20 LLM as a Judge
7:05 MLFlow GenAI
8:01 What is a Trace
10:58 Tracing Sample
#databricks #mlflow #agentevaluation #llms #mlops
