Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

out_s3: add description of parquet compression #1380

Open
wants to merge 12 commits into
base: master
Choose a base branch
from
Open

out_s3: add description of parquet compression #1380

wants to merge 12 commits into from

Commits on May 24, 2024

  1. out_s3: Add descriptions for parquet compression related parameters 

    Signed-off-by: Hiroshi Hatake <[email protected]>
    @cosmo0920
    cosmo0920 committed May 24, 2024
    Configuration menu
    Copy the full SHA
    e154309 View commit details
    Browse the repository at this point in the history

  2. out_s3: Add an example configuration for parquet 

    Signed-off-by: Hiroshi Hatake <[email protected]>
    @cosmo0920
    cosmo0920 committed May 24, 2024
    Configuration menu
    Copy the full SHA
    b872799 View commit details
    Browse the repository at this point in the history

  3. out_s3: Fix a typo 

    Signed-off-by: Hiroshi Hatake <[email protected]>
    @cosmo0920
    cosmo0920 committed May 24, 2024
    Configuration menu
    Copy the full SHA
    9b411e4 View commit details
    Browse the repository at this point in the history

  4. out_s3: Add more concrete description for columnify requirements 

    Signed-off-by: Hiroshi Hatake <[email protected]>
    @cosmo0920
    cosmo0920 committed May 24, 2024
    Configuration menu
    Copy the full SHA
    0b6238b View commit details
    Browse the repository at this point in the history

  5. Update pipeline/outputs/s3.md 

    Co-authored-by: Pat <[email protected]>
Signed-off-by: Hiroshi Hatake <[email protected]>
    @cosmo0920 @patrick-stephens
    cosmo0920 and patrick-stephens committed May 24, 2024
    Configuration menu
    Copy the full SHA
    073b167 View commit details
    Browse the repository at this point in the history

  6. out_s3: Add bytes unit explicitly 

    Signed-off-by: Hiroshi Hatake <[email protected]>
    @cosmo0920
    cosmo0920 committed May 24, 2024
    Configuration menu
    Copy the full SHA
    ccdf7e1 View commit details
    Browse the repository at this point in the history

  7. out_s3: Add more descriptions for parquet.compression parameter which… 

    … indicates that lower case is also accepted

Signed-off-by: Hiroshi Hatake <[email protected]>
    @cosmo0920
    cosmo0920 committed May 24, 2024
    Configuration menu
    Copy the full SHA
    38a32d2 View commit details
    Browse the repository at this point in the history

Commits on May 27, 2024

  1. out_s3: Add a link for columnify 

    Signed-off-by: Hiroshi Hatake <[email protected]>
    @cosmo0920
    cosmo0920 committed May 27, 2024
    Configuration menu
    Copy the full SHA
    362d632 View commit details
    Browse the repository at this point in the history

  2. out_s3: Mention target people explicitly 

    Signed-off-by: Hiroshi Hatake <[email protected]>
    @cosmo0920
    cosmo0920 committed May 27, 2024
    Configuration menu
    Copy the full SHA
    55ab7ac View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2024

  1. out_s3: Add more description for configurable parquet.process_dir par… 

    …ameter

Signed-off-by: Hiroshi Hatake <[email protected]>
    @cosmo0920
    cosmo0920 committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    48cf583 View commit details
    Browse the repository at this point in the history

  2. out_s3: Add an example for building columnify command inside containers 

    Signed-off-by: Hiroshi Hatake <[email protected]>
    @cosmo0920
    cosmo0920 committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    94838f3 View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2024

  1. out_s3: Update a default value for parquet.process_dir parameter 

    Signed-off-by: Hiroshi Hatake <[email protected]>
    @cosmo0920
    cosmo0920 committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    08a802d View commit details
    Browse the repository at this point in the history