Apache Spark Architecture with Spark Context Driver and Executor

In this video I talk about how spark works and what is happening when you execute a job. We look into the Spark Driver program Spark Executors and Tasks. How Spark schedules tasks and how tasks are executed on the executors. This is a short clip of episode #100. ►Learn Data Engineering with my Data Engineering Academy: https://learndataengineering.com Check out my free 100+ pages data engineering cookbook on GitHub: https://github.com/andkret/Cookbook Please SUPPORT WHAT YOU LIKE: - As an Amazon Associate I earn from qualifying purchases from Amazon. Just use this link: https://www.amazon.com/shop/plumbersofdatascience #ApacheSpark #DataEngineering #PlumbersofDataScience #bigdata