Working with Databricks and Writing a Python Script to Clean/Transform Data

This is the forth video of an eight part video series on how to build an Azure data pipeline from scratch. In this video, we load data from the Azure Data Lake, write a Python script to clean/transform it and then write the clean data back into a new Data Lake folder. We also go over some helpful Databricks tips. Below is the link to the entire video series: https://www.youtube.com/watch?v=7tvg-UMdes0&list=PLX_uXCDfdJzhzrY2OvyLkmeyDAF2LnX0R