Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: support reading delta tables with delta plugin #263

Merged
merged 22 commits into from
Oct 25, 2023
Merged

feat: support reading delta tables with delta plugin #263

merged 22 commits into from
Oct 25, 2023

Commits on Oct 13, 2023

  1. add delta read plugin

    @milicevica23
    milicevica23 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    2914aed View commit details
    Browse the repository at this point in the history

  2. add time travel; remote storage (should test)

    @milicevica23
    milicevica23 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    14558bc View commit details
    Browse the repository at this point in the history

  3. add simple test showcase

    @milicevica23
    milicevica23 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    f2d0aa7 View commit details
    Browse the repository at this point in the history

  4. add notebook with delta+conn testing

    @milicevica23
    milicevica23 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    b2e9e76 View commit details
    Browse the repository at this point in the history

  5. make duplicate connection example simple

    @milicevica23
    milicevica23 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    d3366eb View commit details
    Browse the repository at this point in the history

  6. simplify test_delta

    @milicevica23
    milicevica23 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    919b233 View commit details
    Browse the repository at this point in the history

  7. try to register df to localsession

    @milicevica23
    milicevica23 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    b6a67c1 View commit details
    Browse the repository at this point in the history

  8. add df registration

    @milicevica23
    milicevica23 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    ddda919 View commit details
    Browse the repository at this point in the history

  9. refactor registered df; delete launch

    @milicevica23
    milicevica23 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    c072ced View commit details
    Browse the repository at this point in the history

  10. delete test delta

    @milicevica23
    milicevica23 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    959a1c1 View commit details
    Browse the repository at this point in the history

  11. delete redudant configure call

    @milicevica23
    milicevica23 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    806e04f View commit details
    Browse the repository at this point in the history

  12. addapt test; add create schema; fix storage

    @milicevica23
    milicevica23 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    cbca70d View commit details
    Browse the repository at this point in the history

  13. add delta_table3_expected in test

    @milicevica23
    milicevica23 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    0faf9bb View commit details
    Browse the repository at this point in the history

  14. update readme

    @milicevica23
    milicevica23 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    d891d91 View commit details
    Browse the repository at this point in the history

  15. fix readme

    @milicevica23
    milicevica23 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    eba3f7f View commit details
    Browse the repository at this point in the history

Commits on Oct 15, 2023

  1. change pyarrow_table to pyarrow_dataset; use tempfile

    @milicevica23
    milicevica23 committed Oct 15, 2023
    Configuration menu
    Copy the full SHA
    3d64d08 View commit details
    Browse the repository at this point in the history

  2. use tempfile

    @milicevica23
    milicevica23 committed Oct 15, 2023
    Configuration menu
    Copy the full SHA
    09dfe1a View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2023

  1. refactor df registration for more general approach

    @milicevica23
    milicevica23 committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    0cd1f35 View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2023

  1. With linting enabled and fixes for it

    @jwills
    jwills committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    040bd54 View commit details
    Browse the repository at this point in the history

  2. See if that makes the precommit checks happier

    @jwills
    jwills committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    6ec7466 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2023

  1. adapt readme; add default materialization config

    @milicevica23
    milicevica23 committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    b48be37 View commit details
    Browse the repository at this point in the history

  2. format fixes

    @jwills
    jwills committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    689d35d View commit details
    Browse the repository at this point in the history