Vaex is a Python library with a DataFrame API that works efficiently with big (~1 billion rows) tabular datasets. Using an expression system and memory mapping, all operations can be performed lazily and in chunks, while using a familiar DataFrame API and regular numpy expressions, enabling data cleansing, on the fly computations and visualizations for massive datasets on even laptops.
See the full SciPy 2019 playlist at https://www.youtube.com/playlist?list=PLYx7XA2nY5GcDQblpQ_M1V3PQPoLWiDAC
Connect with us!
*****************
https://twitter.com/enthought
https://www.facebook.com/Enthought/
https://www.linkedin.com/company/enthought