Skip to content

RumbleDB/rumble

This branch is 67 commits ahead of, 491 commits behind master.

Folders and files

NameName
Last commit message
Last commit date

Latest commit

author
Ghislain Fourny
Oct 28, 2024
5bb9f22 · Oct 28, 2024
Jul 12, 2024
Jul 10, 2024
Mar 7, 2024
Jul 10, 2024
Jul 12, 2024
Jul 10, 2024
May 16, 2024
Jul 10, 2024
Jan 22, 2020
May 25, 2023
Sep 18, 2017
Nov 1, 2021
Sep 11, 2019
Apr 16, 2019
Jul 6, 2020
Sep 18, 2017
Oct 23, 2019
Jun 4, 2019
Mar 23, 2020
Sep 18, 2017
Dec 15, 2020
Nov 1, 2021
Sep 18, 2017
May 16, 2023
Oct 19, 2022
Mar 6, 2024
Mar 6, 2024
Jul 10, 2024
Feb 11, 2020
Oct 28, 2024
Sep 4, 2020
Feb 11, 2020

RumbleDB

With RumbleDB, you can query with ease a lot of different nested, heterogeneous data formats like JSON, CSV, Parquet, Avro, LibSVM, text, etc.

RumbleDB exposes a query language rather than a DataFrame API, for more flexibility, more productivity but also because a lot of data simply will not fit in DataFrames.

You can query it in place from any local file systems or data lakes (Azure blob storage, Amazon S3, HDFS, etc).

You can prepare, clean up, validate your data and put it right into your machine learning pipelines with RumbleDB ML.

Getting started: you will find a Jupyter notebook that introduces the JSONiq language on top of RumbleDB here. You can also run it locally if you prefer.

The documentation also contains an introduction specific to RumbleDB and how you can read input datasets, but we have not converted it to Jupyter notebooks yet (this will follow).

The documentation of the latest official release is available here.

The documentation of the current master (for the adventurous and curious) is available here.

RumbleDB is an effort involving many researchers and ETH Zurich students: code and support by Stefan Irimescu, Ghislain Fourny, Gustavo Alonso, Renato Marroquin, Rodrigo Bruno, Falko Noé, Ioana Stefan, Andrea Rinaldi, Stevan Mihajlovic, Mario Arduini, Can Berker Çıkış, Elwin Stephan, David Dao, Zirun Wang, Ingo Müller, Dan-Ovidiu Graur, Thomas Zhou, Olivier Goerens, Alexandru Meterez, Remo Röthlisberger, Dominik Bruggisser, David Loughlin.