Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(ingest/snowflake): tables from snowflake shares as siblings #8531

Merged
merged 22 commits into from
Aug 24, 2023
Merged

feat(ingest/snowflake): tables from snowflake shares as siblings #8531

merged 22 commits into from
Aug 24, 2023

Commits on Jul 26, 2023

  1. feat(ingest/snowflake): tables from snowflake shares as siblings 

    1. add config maps to accept inbound and outbound share details from user
2. emit mirrored database tables as siblings, with tables from share owner(producer) account as primary sibling.
3. push down allow-deny patterns in snowflake_schema
    @mayurinehate
    mayurinehate committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    47bb20d View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2023

  1. add unit tests, docs, logging

    @mayurinehate
    mayurinehate committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    752b2dd View commit details
    Browse the repository at this point in the history

  2. remove node itself from sibling, more TODO

    @mayurinehate
    mayurinehate committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    daf87ef View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2023

  1. update tests, comments

    @mayurinehate
    mayurinehate committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    8018e5a View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into snowflake_shares_lineage_siblings

    @mayurinehate
    mayurinehate authored Jul 31, 2023
    Configuration menu
    Copy the full SHA
    f704d9c View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2023

  1. revert push down filtering changes near query

    @mayurinehate
    mayurinehate committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    69e3792 View commit details
    Browse the repository at this point in the history

  2. change config structure to allow same shares config across accounts

    @mayurinehate
    mayurinehate committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    4ce37e5 View commit details
    Browse the repository at this point in the history

  3. fix

    @mayurinehate
    mayurinehate committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    b33cafd View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into snowflake_shares_lineage_siblings

    @mayurinehate
    mayurinehate authored Aug 1, 2023
    Configuration menu
    Copy the full SHA
    ea1ba40 View commit details
    Browse the repository at this point in the history

  5. fix indent

    @mayurinehate
    mayurinehate committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    f19d1ed View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2023

  1. Merge branch 'master' into snowflake_shares_lineage_siblings

    @mayurinehate
    mayurinehate authored Aug 4, 2023
    Configuration menu
    Copy the full SHA
    89a06b1 View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2023

  1. Merge branch 'master' into snowflake_shares_lineage_siblings

    @mayurinehate
    mayurinehate authored Aug 14, 2023
    Configuration menu
    Copy the full SHA
    4f6035a View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2023

  1. Merge branch 'master' into snowflake_shares_lineage_siblings

    @mayurinehate
    mayurinehate authored Aug 22, 2023
    Configuration menu
    Copy the full SHA
    6d4be65 View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2023

  1. Merge branch 'master' into snowflake_shares_lineage_siblings

    @mayurinehate
    mayurinehate authored Aug 23, 2023
    Configuration menu
    Copy the full SHA
    cfd3924 View commit details
    Browse the repository at this point in the history

  2. update doc content, refractor to avoid assers

    @mayurinehate
    mayurinehate committed Aug 23, 2023
    Configuration menu
    Copy the full SHA
    78eba30 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into snowflake_shares_lineage_siblings

    @mayurinehate
    mayurinehate authored Aug 23, 2023
    Configuration menu
    Copy the full SHA
    d1bc494 View commit details
    Browse the repository at this point in the history

  4. simplification refractor

    @mayurinehate
    mayurinehate committed Aug 23, 2023
    Configuration menu
    Copy the full SHA
    1a77245 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'refs/remotes/origin/snowflake_shares_li… 

    …neage_siblings' into snowflake_shares_lineage_siblings
    @mayurinehate
    mayurinehate committed Aug 23, 2023
    Configuration menu
    Copy the full SHA
    c55e37a View commit details
    Browse the repository at this point in the history

  6. Update snowflake_pre.md

    @mayurinehate
    mayurinehate authored Aug 23, 2023
    Configuration menu
    Copy the full SHA
    afbe095 View commit details
    Browse the repository at this point in the history

  7. remove no-op

    @mayurinehate
    mayurinehate committed Aug 23, 2023
    Configuration menu
    Copy the full SHA
    02585c4 View commit details
    Browse the repository at this point in the history

  8. Merge remote-tracking branch 'refs/remotes/origin/snowflake_shares_li… 

    …neage_siblings' into snowflake_shares_lineage_siblings
    @mayurinehate
    mayurinehate committed Aug 23, 2023
    Configuration menu
    Copy the full SHA
    b28ebb1 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'master' into snowflake_shares_lineage_siblings

    @mayurinehate
    mayurinehate authored Aug 23, 2023
    Configuration menu
    Copy the full SHA
    6cde852 View commit details
    Browse the repository at this point in the history