Apache Spark Optimization | 60% Runtime reduction | WINDOW vs MAX By | DBR | Query Profile

Spark job runtime reduction by switching from WINDOW operation to MAX_BY operation #dataengineering #dataanalytics #apachespark #spark #performance #databricks