Polars vs Spark - Larger Than Memory Datasets

Polars (Rust based) is faster than Apache Spark on larger than memory dataset. https://dataengineeringcentral.substack.com/p/spark-vs-polars-real-life-test-case #rust #polars #python #spark #dataengineering