Featurization (4/5)

Unlock the full self-paced class from Databricks Academy! Introduction to Data Science and Machine Learning (AWS Databricks) https://academy.databricks.com/course/SP860 Introduction to Data Science and Machine Learning (Azure Databricks) https://academy.databricks.com/course/SP860-Az In this video, Conor prepares the data for final model fitting. He first demonstrates the preparation of a Train/Test Split on the data set and discusses the importance of this technique in terms of preventing model overfitting. Next, Conor shows how to use Spark ML Transformers to complete data preparation via a Featurization Pipeline. Download the code here: https://files.training.databricks.com/classes/ml/ml-on-spark.dbc Don't have a Databricks Account? Sign up for Community Edition: https://databricks.com/try-databricks This is Part 4 of our Introduction to Machine Learning Video Series: https://www.youtube.com/playlist?list=PLroeQp1c-t3pT3_d6JmjVnBdOKpyeQtQr