MetLife Data Engineer Interview Question | PySpark Aggregation & SQL Logic

This video breaks down one of the most frequently asked Data Engineer interview questions, commonly seen in MetLife and other top MNC interviews. You’ll learn how to solve a real-world PySpark + SQL-style problem that tests far more than basic syntax. Although this looks like an easy-level question, it quietly evaluates multiple core data engineering concepts used in production systems. 🔍 What you’ll learn in this video: How to read interview questions correctly and spot hidden requirements Using groupBy + aggregation in PySpark Applying conditional logic (when / otherwise) inside aggregations Filtering results based on business rules Translating interview logic into industry-ready data transformations This exact style of question has appeared in: Data Engineer interviews Data Analyst interviews Business Analyst interviews Credit & finance-focused MNCs like MetLife 📌 Why this question matters: Questions like this simulate real project logic used in analytics pipelines and reporting layers. Mastering them helps you: Think like a data engineer, not just write code Handle edge cases interviewers expect you to miss Build confidence for PySpark, SQL, and Databricks interviews Subscribe to Shilpa Data Insights for upcoming episodes with more data engineers sharing their interview prep journeys, real projects, and success strategies. 📚 More Resources: Link to Spark playlist: https://www.youtube.com/playlist?list=PLHcpPiCf7ryZf8GAFKcFuYmOxswcCOGz4 Link to Databricks playlist: https://www.youtube.com/playlist?list=PLHcpPiCf7ryZLNLvSsglM05lJXaWngHUH Link to Databricks certification : https://www.youtube.com/playlist?list=PLHcpPiCf7ryZrusmfkgteZvSMO16hagP5 Link to Big data: https://www.youtube.com/playlist?list=PLHcpPiCf7ryYfIrrJBQDa0Vw9BXIY-mUD Link to Interview series for Pyspark (40+ questions): https://www.youtube.com/playlist?list=PLHcpPiCf7ryYp8KKn0sWfLugYEEsF2UOf Need Help ? Connect With me 1:1 -:- https://topmate.io/shilpa_das10 👉 𝗝𝗼𝗶𝗻 𝗚𝗿𝗼𝘂𝗽 𝗛𝗲𝗿𝗲 𝘁𝗼 𝗚𝗲𝘁 𝗦𝘂𝗰𝗵 𝗠𝗼𝗿𝗲 𝗥𝗲𝘀𝗼𝘂𝗿𝗰𝗲𝘀 : https://whatsapp.com/channel/0029Vb5j5Ku0VycHdViPPJ1Y 👉 If you’re preparing for Data Engineer interviews in 2025–2026, this is a must-watch.