We're pleased to present Alex Kesling on Apache Arrow DataFusion: a Fast, Embeddable, Modular Analytic Query Engine http://andrew.nerdnetworks.org/other/SIGMOD-2024-lamb.pdf
---
We'd like to thank Datadog for sponsoring the PWL NYC Meetup
Join the Pack! https://careers.datadoghq.com/
---
DataFusion represents a new category of database technologies: "deconstructed databases". It's a relational engine on which you can graft any language frontend (with SQL provided out of the box) and point it at any data you want.
How could one technology possibly do the same work as SQLite, PostgreSQL, Pandas, DuckDB, what-have-you all in one package? Let's read the paper and talk about it.
---
Alex Kesling is the cofounder of Empathic, a new company exploring the intersection of enterprise data infrastructure and agentic AI. He previously worked on Google's Search and Knowledge Graph infrastructure, VR/AR tools for teachers, and a plethora of consulting projects. Alex loves systems design, time series visualization, distributed systems, and that one turkey sandwich the day after Thanksgiving.