Repositories list

• datafusion-dft

  Public
  Batteries included CLI, TUI, and server implementations for DataFusion.

  clidatadatabase+ 3arrowtuidatafusion

  Rust

  •

  Apache License 2.0

  •12•135•31•5•Updated Mar 5, 2025Mar 5, 2025

• datafusion-table-providers

  Public
  DataFusion TableProviders for reading data from other systems

  Rust

  •

  Apache License 2.0

  •26•88•5•9•Updated Mar 5, 2025Mar 5, 2025

• datafusion-materialized-views

  Public
  Incremental view maintenance & query rewriting for materialized views in DataFusion

  rustsqlbig-data+ 3arrowmaterialized-viewsdatafusion

  Rust

  •

  Apache License 2.0

  •1•26•1•2•Updated Mar 4, 2025Mar 4, 2025

• arrow-zarr

  Public
  Implementation of Zarr file format in Rust

  Rust

  •

  Apache License 2.0

  •1•11•4•0•Updated Mar 3, 2025Mar 3, 2025

• datafusion-functions-json

  Public
  JSON support for DataFusion (unofficial)

  Rust

  •

  Apache License 2.0

  •15•37•6•3•Updated Mar 3, 2025Mar 3, 2025

• datafusion-java

  Public
  Java binding to Apache DataFusion

  javaarrowdatafusion+ 1ballista

  Java

  •

  Apache License 2.0

  •14•76•9•6•Updated Mar 3, 2025Mar 3, 2025

• datafusion-wasm-bindings

  Public
  WASM bindings for DataFusion

  Rust

  •

  Apache License 2.0

  •1•18•5•0•Updated Feb 25, 2025Feb 25, 2025

• datafusion-flight-sql-server

  Public
  DataFusion FlightSQL Server

  Rust

  •

  Apache License 2.0

  •2•8•0•5•Updated Feb 24, 2025Feb 24, 2025

• datafusion-federation

  Public
  Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.

  Rust

  •

  Apache License 2.0

  •19•101•3•0•Updated Feb 24, 2025Feb 24, 2025

• hdfs-native-object-store

  Public
  Native rust implementation of object_store HDFS

  Rust

  •

  Apache License 2.0

  •7•5•0•0•Updated Feb 12, 2025Feb 12, 2025

• orc-rust

  Public
  Rust implementation of Apache ORC

  Rust

  •

  Apache License 2.0

  •8•15•23•2•Updated Jan 19, 2025Jan 19, 2025

• datafusion-sqlancer

  Public
  End-to-end SQL fuzz testing for DataFusion using SQLancer

  Java

  •

  MIT License

  •1•12•0•10•Updated Jan 6, 2025Jan 6, 2025

• datafusion-orc

  Public
  Implementation of Apache ORC file format use Apache Arrow in-memory format

  Rust

  •

  Apache License 2.0

  •14•44•4•0•Updated Jan 3, 2025Jan 3, 2025

• test-data

  Public
  Standard DataFusion contrib test datasets

  Roff

  •

  Apache License 2.0

  •0•1•0•0•Updated Nov 28, 2024Nov 28, 2024

• datafusion-query-cache

  Public
  results cache for Apache DataFusion

  Rust

  •

  Apache License 2.0

  •3•21•0•0•Updated Oct 29, 2024Oct 29, 2024

• datafusion-functions-extra

  Public
  Various additional function packages for Apache DataFusion (unofficial)

  datafusionaggregate-functions

  Rust

  •

  Apache License 2.0

  •5•8•1•0•Updated Oct 26, 2024Oct 26, 2024

• datafusion-functions-variant

  Public
  DataFusion package for the Open Variant type

  Rust

  •

  Apache License 2.0

  •0•4•6•5•Updated Oct 8, 2024Oct 8, 2024

• ray-sql

  Public archive
  Distributed SQL Query Engine in Python using Ray

  Rust

  •

  Apache License 2.0

  •16•244•3•2•Updated Oct 2, 2024Oct 2, 2024

• datafusion-table-provider-flight

  Public
  FlightSQL TableProvider for DataFusion

  Rust

  •

  Apache License 2.0

  •1•4•0•0•Updated Aug 27, 2024Aug 27, 2024

• tpctools

  Public
  Tools for generating TPC-* datasets

  Rust

  •

  Apache License 2.0

  •5•26•3•1•Updated Jun 23, 2024Jun 23, 2024

• datafusion-async-parquet-index

  Public
  Example of building external index on parquet files with an remote catalog

  Rust

  •

  Apache License 2.0

  •1•6•0•0•Updated Jun 18, 2024Jun 18, 2024

• datafusion-index-provider

  Public
  Prototype approaches to implementing Indexes in DataFusion

  Apache License 2.0

  •1•4•1•0•Updated May 6, 2024May 6, 2024

• fs-hdfs

  Public
  C

  •

  Apache License 2.0

  •6•5•1•3•Updated May 3, 2024May 3, 2024

• datafusion-catalogprovider-glue

  Public
  Rust

  •

  Apache License 2.0

  •4•21•2•1•Updated May 2, 2024May 2, 2024

• datafusion-sprox

  Public
  A DataFusion-powered Serverless S3 Proxy.

  Rust

  •

  Apache License 2.0

  •1•15•1•0•Updated Apr 15, 2024Apr 15, 2024

• datafusion-wasm-playground

  Public
  Web based playground for Apache DataFusion via WASM

  TypeScript

  •

  Apache License 2.0

  •1•10•1•1•Updated Apr 9, 2024Apr 9, 2024

• bdt

  Public
  Boring Data Tool

  jsoncsvavro+ 2convertparquet

  Rust

  •

  Apache License 2.0

  •21•214•8•2•Updated Mar 21, 2024Mar 21, 2024

• datafusion-c

  Public
  C language bindings for DataFusion

  cglibapache-arrow+ 2datafusionsql

  C

  •

  Apache License 2.0

  •5•20•4•2•Updated Mar 11, 2024Mar 11, 2024

• datafusion-objectstore-hdfs

  Public
  HDFS based on Java implementation as a remote ObjectStore for DataFusion

  Rust

  •

  Apache License 2.0

  •9•10•5•1•Updated Feb 13, 2024Feb 13, 2024

• sqlbench-runners

  Public
  SQLBench Runners

  Rust

  •

  Apache License 2.0

  •3•13•0•0•Updated Dec 17, 2023Dec 17, 2023