How to work with/manipulate String columns in Spark Dataframe

#Apache #Spark #CCA175 #String columns #Dataframe In this video we will learn how to manipulate/work with String columns in a Dataframe in Apache Spark. Objectives We will understand the basic string functions concat_ws Lower / lower regexp_replace split substring Download the sample data from our Github repository. https://github.com/proedu-organisation/CCA-175-practice-tests-resource 🔵 COMPLETE APACHE SPARK TUTORIAL PLAYLIST 🔵 ✔️ https://www.youtube.com/watch?v=qV7Kkjwx-0g&list=PLxPiYXz4lGTPrVtd89y-SXiXZeBEwpvlz 🔵 WORKING WITH STRUCTURED DATA IN APACHE SPARK 🔵 ✔️ How to read write CSV file https://www.youtube.com/watch?v=Hr6Co9UglYw&list=PLxPiYXz4lGTPrVtd89y-SXiXZeBEwpvlz&index=7\ ✔️ How to read/write AVRO file https://www.youtube.com/watch?v=t1m26sCuY08&list=PLxPiYXz4lGTPrVtd89y-SXiXZeBEwpvlz&index=8 ✔️ How to read write Parquet file data https://www.youtube.com/watch?v=3BOchZ8rRfA&list=PLxPiYXz4lGTPrVtd89y-SXiXZeBEwpvlz&index=9 ✔️ How to read/write JSON file https://www.youtube.com/watch?v=aLTJeldPhpY&list=PLxPiYXz4lGTPrVtd89y-SXiXZeBEwpvlz&index=10 ✔️ How to read/write Hive Metastore https://www.youtube.com/watch?v=6-LtMmNAvIE&list=PLxPiYXz4lGTPrVtd89y-SXiXZeBEwpvlz&index=11 🔵 WORKING WITH DATE COLUMNS IN APACHE SPARK 🔵 ✔️ Manipulate Date in Spark dataframe https://www.youtube.com/watch?v=yGJJL2puHbw&list=PLxPiYXz4lGTPrVtd89y-SXiXZeBEwpvlz&index=13 ✔️ Work with/manipulate String columns https://www.youtube.com/watch?v=4pK8mIZj-lg&list=PLxPiYXz4lGTPrVtd89y-SXiXZeBEwpvlz&index=12 🔵 WORKING WITH WINDOWING, AGGREGATE FUNCTIONS IN APACHE SPARK 🔵 ✔️ Ranking Functions in Apache Spark https://www.youtube.com/watch?v=06xsK1QQ-jA&list=PLxPiYXz4lGTPrVtd89y-SXiXZeBEwpvlz&index=14 ✔️ Windowing Functions in Apache Spark https://www.youtube.com/watch?v=DwEVMLHlaME&list=PLxPiYXz4lGTPrVtd89y-SXiXZeBEwpvlz&index=15 ✔️ Analytical Functions in Spark https://www.youtube.com/watch?v=6-LwS_zLwPs&list=PLxPiYXz4lGTPrVtd89y-SXiXZeBEwpvlz&index=16