Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: import_stream internal method for Series to support Arrow C stream interface #1078

Merged
merged 27 commits into from
May 8, 2024
Merged

feat: import_stream internal method for Series to support Arrow C stream interface #1078

merged 27 commits into from
May 8, 2024

Commits on May 5, 2024

  1. refactor: import_stream method for Series

    @eitsupi
    eitsupi committed May 5, 2024
    Configuration menu
    Copy the full SHA
    98a81ec View commit details
    Browse the repository at this point in the history

  2. test: add test

    @eitsupi
    eitsupi committed May 5, 2024
    Configuration menu
    Copy the full SHA
    16ec40f View commit details
    Browse the repository at this point in the history

Commits on May 6, 2024

  1. test: more tests for nanoarrow

    @eitsupi
    eitsupi committed May 6, 2024
    Configuration menu
    Copy the full SHA
    9f095c1 View commit details
    Browse the repository at this point in the history

  2. refactor: handle name in rust side

    @eitsupi
    eitsupi committed May 6, 2024
    Configuration menu
    Copy the full SHA
    2b976c1 View commit details
    Browse the repository at this point in the history

  3. refactor!: use the Arrow C Stream interface inside `as_polars_df(<arr… 

    …ow::RecordBatchReader>)` and remove unused internal functions
    @eitsupi
    eitsupi committed May 6, 2024
    Configuration menu
    Copy the full SHA
    c6b4ee7 View commit details
    Browse the repository at this point in the history

  4. refactor: simplify type check for struct nanoarrow_array_stream

    @eitsupi
    eitsupi committed May 6, 2024
    Configuration menu
    Copy the full SHA
    8de1e21 View commit details
    Browse the repository at this point in the history

  5. feat: as_polars_df for arrow::RecordBatchReader

    @eitsupi
    eitsupi committed May 6, 2024
    Configuration menu
    Copy the full SHA
    bbba938 View commit details
    Browse the repository at this point in the history

  6. refactor!: rewrite as_polars_df to use Arrow C Stream interface

    @eitsupi
    eitsupi committed May 6, 2024
    Configuration menu
    Copy the full SHA
    350689c View commit details
    Browse the repository at this point in the history

  7. docs(news): add bluets

    @eitsupi
    eitsupi committed May 6, 2024
    Configuration menu
    Copy the full SHA
    e4fdaad View commit details
    Browse the repository at this point in the history

  8. Merge remote-tracking branch 'upstream/main' into import_stream

    @eitsupi
    eitsupi committed May 6, 2024
    Configuration menu
    Copy the full SHA
    f7d917a View commit details
    Browse the repository at this point in the history

  9. test: ensure auto rechunk

    @eitsupi
    eitsupi committed May 6, 2024
    Configuration menu
    Copy the full SHA
    a70fbf6 View commit details
    Browse the repository at this point in the history

  10. test: add comment about the test case

    @eitsupi
    eitsupi committed May 6, 2024
    Configuration menu
    Copy the full SHA
    a543e95 View commit details
    Browse the repository at this point in the history

  11. docs: update examples to remove removed options

    @eitsupi
    eitsupi committed May 6, 2024
    Configuration menu
    Copy the full SHA
    4cab33b View commit details
    Browse the repository at this point in the history

  12. Revert "refactor!: rewrite as_polars_df to use Arrow C Stream inter… 

    …face"

This reverts commit 350689c.
    @eitsupi
    eitsupi committed May 6, 2024
    Configuration menu
    Copy the full SHA
    fa5e600 View commit details
    Browse the repository at this point in the history

  13. feat: add the experimental argument to use the import_stream method i… 

    …nside the function
    @eitsupi
    eitsupi committed May 6, 2024
    Configuration menu
    Copy the full SHA
    e04762c View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. feat: re add $from_arrow_record_batches

    @eitsupi
    eitsupi committed May 7, 2024
    Configuration menu
    Copy the full SHA
    fe06f29 View commit details
    Browse the repository at this point in the history

  2. feat: add experimental option to use C stream interface

    @eitsupi
    eitsupi committed May 7, 2024
    Configuration menu
    Copy the full SHA
    2fde92a View commit details
    Browse the repository at this point in the history

  3. test: re add tests for as_polars_df(<ArrowTabular>)

    @eitsupi
    eitsupi committed May 7, 2024
    Configuration menu
    Copy the full SHA
    303ea0b View commit details
    Browse the repository at this point in the history

  4. test: update snapshot

    @eitsupi
    eitsupi committed May 7, 2024
    Configuration menu
    Copy the full SHA
    89fc55c View commit details
    Browse the repository at this point in the history

  5. chore: auto formatting

    @eitsupi
    eitsupi committed May 7, 2024
    Configuration menu
    Copy the full SHA
    e3b9567 View commit details
    Browse the repository at this point in the history

  6. docs(news): update NEWS about C stream interface

    @eitsupi
    eitsupi committed May 7, 2024
    Configuration menu
    Copy the full SHA
    5a97690 View commit details
    Browse the repository at this point in the history

  7. refactor: simplify

    @eitsupi
    eitsupi committed May 7, 2024
    Configuration menu
    Copy the full SHA
    2b5e8a6 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2024

  1. fix: experimental argument for as_polars_df(<nanoarrow_array_stream… 

    …>) works
    @eitsupi
    eitsupi committed May 8, 2024
    Configuration menu
    Copy the full SHA
    038afb6 View commit details
    Browse the repository at this point in the history

  2. docs(news): more notes about the Arrow C stream interface

    @eitsupi
    eitsupi committed May 8, 2024
    Configuration menu
    Copy the full SHA
    b2277fb View commit details
    Browse the repository at this point in the history

  3. test: skip judges should be done inside .cases

    @eitsupi
    eitsupi committed May 8, 2024
    Configuration menu
    Copy the full SHA
    db284af View commit details
    Browse the repository at this point in the history

  4. refactor: simplify

    @eitsupi
    eitsupi committed May 8, 2024
    Configuration menu
    Copy the full SHA
    ccb51e7 View commit details
    Browse the repository at this point in the history

  5. test: add more tests for the experimental argument

    @eitsupi
    eitsupi committed May 8, 2024
    Configuration menu
    Copy the full SHA
    b6cc521 View commit details
    Browse the repository at this point in the history