Learning Journal

83K subscribers

898 videos

Learn more at https://www.scholarnest.in?ref=ae0dde Data Engineering Learning Path https://www.scholarnest.in/bundles/mastering-spark-and-databricks-cloud?re...

Latest Videos

AI profile review Check your resume against a JD and get shortlisted.

How to tune union operation in Apache Spark Apache Spark Performance Tuning and Optimization

How to increase spark executor memory to fix the data spill problem Spark performance optimization

What is data explosion in Apache Spark How to detect and tune data explosion Performance Tuning

How to detect and tune data spill problem in Apache spark Apache Spark performance optimization

Apache Spark executor memory architecture How to estimate the Spark Executor Memory

What is data spill and how to handle data spill problem in Apache Spark Performance Tuning

How to tune small file problem in Spark using openCostInBytes Spark performance optimization

How to tune Spark data frame shuffle partitions Apache Spark Performance Tuning

Tuning Spark queries using index Apache Spark performance tuning and optimization

How to handle small file problem in Apache spark Apache Spark performance tuning and optimization

Why my Spark SQL query is taking soo long even if I am reading only 100 records Spark Tuning

Overview of the Data Lake Architecture

How to cripple your predicate pushdown in Apache Spark Performance Tuning Apache Spark

Microproject – Requirement

SQL Classification

How to test your SQL environment

What is Spark and Why it is replacing Hadoop

How to download your resources

About the course

Why filters are not improving Spark SQL Query Performance How to optimize Spark with filters

Overview of Hadoop Platform

How to reduce cache size in Apache Spark How much data can you cache in Apache Spark memory

Monolithic and Distributed Architecture for Big Data Systems

How to reuse and cache Spark Dataframe to optimize performance Apache Spark performance tuning

How to test your SQL environment

Data Engineering tools and technologies

Big data challenge and limitations for data warehouse architecture

How to tune Data Read in Apache Spark How can you read faster in Apache Spark data frame

Data Engineering Platform Architectures