cross validation in machine learning | hyper parameter optimization Part 3

what is cross-validation, and why should you care about it? In the realm of data-driven decision-making, it's important to recognize the challenges that arise when working with limited data. One such challenge is the dilemma of partitioning data into training and validation sets, which can significantly impact the outcomes and generalization of machine learning models. The results can even be influenced by the random selection of these sets, leading to potential bias. However, there's a powerful solution to this problem known as cross-validation, often abbreviated as CV. Cross-validation redefines how we approach model training and validation, allowing us to harness the full potential of our data without the constraints of arbitrary set selections. In the following minutes, we'll break it down into simple terms and show you how this technique can used for hyper parameter tuning and model evaluation & selection. 00:00 recap of hyperparameter and validation set 00:40 Problem in generating validation set 01:40 Cross validation introduction 02:05 K fold in cross validation 03:05 Use case introduction to train model using cross validation 04:40 What is present in folds ? 06:28 Train DT & Evaluate hyper parameter depth 10 using cross validation 11:24 cross validation accuracy 12:55 Train DT & Evaluate hyper parameter depth 15 using cross validation 13:40 Train DT & Evaluate hyper parameter depth 20 using cross validation 14:30 compare & pick best hyperparameter using cross validation accuracy 16:00 Building final model using train set and best hyperparameter value 18:10 Evaluating final model using test set #machinelearningintamil #machinelearning #hyperparametertuning #artificialintelligenceintamil #pythonintamil #MachineLearningValidation #HyperparameterTuning #DataValidationTechniques #MLHyperparameters #ModelValidation #OptimizingMachineLearning #ValidationDatasetTips #HyperparameterTuningMethods #TamilMachineLearning #DataScienceTamil #TamilAI #MLTipsandTricks #TamilDataScience #MachineLearningInTamil #TamilLanguageTech #ModelOptimization #machinelearning, #linearregression ,#machinelearningintamil, #machine learning basics in tamil, #types of machine learning in tamil, #machine learning tutorial, #machine learning algorithms, #what is machine learning, #machine learning tools in tamil, #machine learning course tamil, # linear regression, #simple linear regression tamil, #multiple linear regression in tamil, #linear regression in tamil, #linear regression for beginners in tamil, #simple linear regression, #regression techniques tamil, #regression, #supervised learning tamil, #simple liner regression, #linear regression machine learning, #regression analysis, #linear regression analysis , #Simple linear regression in tamil, #continuous variable #discrete variable #categorical variable #regression model in tamil #statistical model #stats in tamil #statistics in tamil machine learning,machine learning in tamil,machine learning tamil,machine learning tutorial,tamil,machine learning algorithms,machine learning tutorial for beginners,machine learning tutorial in tamil,what is machine learning,machine learning course,machine learning projects,machine learning course tamil,machine learning python tamil,machine learning basics in tamil,machine learning vs deep learning tamil,machine learning python #machinelearning,#machinelearningintamil,#machinelearningtamil,#machinelearningtutorial,#tamil,#machinelearningalgorithms,#machinelearningtutorialforbeginners,#machinelearningtutorialintamil,#whatismachinelearning,#machinelearningcourse,#machinelearningprojects,#machinelearningcoursetamil,#machinelearningpythontamil,#machinelearningbasicsintamil,#machinelearningvsdeeplearningtamil,#machinelearningpython #machinelearning #machinelearningintamil #lineargression