Everyone Should Use Apache Arrow for Data Systems Research

Speaker: Andrew Crotty, Assistant Professor at Northwestern University The conventional wisdom is that it takes about a decade of effort to build a stable, full-featured data analytics system. Unfortunately, this type of systems work does not translate well to academic environments, where resources are more constrained and research progress (e.g., tenure review, funding duration) is typically measured on a much shorter time frame. In this talk, Andrew explains why he believe that Apache Arrow provides a good foundation for data systems research and how his group plans to leverage the Arrow ecosystem in our work going forward.