Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(ingest/dremio): Dremio Source Ingestion #11598

Merged
merged 48 commits into from
Nov 5, 2024
Merged

feat(ingest/dremio): Dremio Source Ingestion #11598

merged 48 commits into from
Nov 5, 2024

Commits on Oct 11, 2024

  1. feat: Dremio Source Ingestion

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    38e5946 View commit details
    Browse the repository at this point in the history

  2. refactor: improvement to metadata gathering

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    a5b8c45 View commit details
    Browse the repository at this point in the history

  3. fix: Update dremio_entity.py

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    4a81b19 View commit details
    Browse the repository at this point in the history

  4. fix: Update dremio_sql_queries.py

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    51c2443 View commit details
    Browse the repository at this point in the history

  5. refactor: Update dremio_source.py

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    84227b6 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2024

  1. feat: Dremio Source Ingestion

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    e462be6 View commit details
    Browse the repository at this point in the history

  2. refactor: improvement to metadata gathering

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    703a3f8 View commit details
    Browse the repository at this point in the history

  3. fix: Update dremio_entity.py

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    4283cb6 View commit details
    Browse the repository at this point in the history

  4. fix: Update dremio_sql_queries.py

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    f897b9e View commit details
    Browse the repository at this point in the history

  5. refactor: Update dremio_source.py

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    ac56777 View commit details
    Browse the repository at this point in the history

  6. test: add integration test for dremio

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    3ce57b9 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. fix: added minor changes + fix testcase

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    e1ee817 View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2024

  1. fix: PR Comments

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    b23e003 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'feat/dremio-connector-source' of https://github.com/sag… 

    …ar-salvi-apptware/datahub into feat/dremio-connector-source
    @acrylJonny
    acrylJonny committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    7247ac1 View commit details
    Browse the repository at this point in the history

  3. switch to drill dialect

    @acrylJonny
    acrylJonny committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    b9d7b8a View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into feat/dremio-connector-source

    @acrylJonny
    acrylJonny authored Oct 21, 2024
    Configuration menu
    Copy the full SHA
    230fbd7 View commit details
    Browse the repository at this point in the history

  5. Update dremio_entities.py

    @acrylJonny
    acrylJonny committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    d979d31 View commit details
    Browse the repository at this point in the history

  6. Update dremio_entities.py

    @acrylJonny
    acrylJonny committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    9244e4c View commit details
    Browse the repository at this point in the history

  7. Update datahub-web-react/src/app/ingest/source/builder/sources.json 

    Co-authored-by: Mayuri Nehate <[email protected]>
    @acrylJonny @mayurinehate
    acrylJonny and mayurinehate authored Oct 21, 2024
    Configuration menu
    Copy the full SHA
    44853b8 View commit details
    Browse the repository at this point in the history

  8. Update metadata-ingestion/docs/sources/dremio/README.md 

    Co-authored-by: Mayuri Nehate <[email protected]>
    @acrylJonny @mayurinehate
    acrylJonny and mayurinehate authored Oct 21, 2024
    Configuration menu
    Copy the full SHA
    fac705c View commit details
    Browse the repository at this point in the history

  9. reafactor: Dremio Authetication

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    29ba440 View commit details
    Browse the repository at this point in the history

  10. Cite Dremio Docs for SchemaFieldTypeMapper

    @acrylJonny
    acrylJonny committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    6574b63 View commit details
    Browse the repository at this point in the history

  11. test: fix ci test

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    9835e31 View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2024

  1. fix: PR comments

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    a6a9a91 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. fix: dataset_pattern changes for tables and views

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    b0c8c08 View commit details
    Browse the repository at this point in the history

  2. add warnings when unable to parse sql query

    @acrylJonny
    acrylJonny committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    ff211af View commit details
    Browse the repository at this point in the history

  3. add view definition aspect

    @acrylJonny
    acrylJonny committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    459cfc8 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2024

  1. bug fix - external urls. Improve Dremio Cloud API support for projects

    @acrylJonny
    acrylJonny committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    224ec10 View commit details
    Browse the repository at this point in the history

  2. fix: ci test

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    0982a1b View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. docs: minor docs changes per pr comments

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    3ce5e02 View commit details
    Browse the repository at this point in the history

  2. fix: PR comments

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    9c1e3fb View commit details
    Browse the repository at this point in the history

  3. docs: minor changes

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    7b938b2 View commit details
    Browse the repository at this point in the history

  4. build: added dependacy for sql

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    6914f75 View commit details
    Browse the repository at this point in the history

  5. test: fix ci test

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    3176e71 View commit details
    Browse the repository at this point in the history

  6. fix: add minor change in report failure

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    9c1c556 View commit details
    Browse the repository at this point in the history

  7. fix: statefull ingestion error

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    6670a98 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2024

  1. fix: PR Comments and added mysql as a source to test

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    3e2eae7 View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2024

  1. fix: PR Comments

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    195f78c View commit details
    Browse the repository at this point in the history

  2. test: Updated the test for platform instance

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    9de8be0 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into feat/dremio-connector-source

    @sagar-salvi-apptware
    sagar-salvi-apptware authored Oct 28, 2024
    Configuration menu
    Copy the full SHA
    102b55f View commit details
    Browse the repository at this point in the history

  4. fix: minor comments

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    8efa349 View commit details
    Browse the repository at this point in the history

  5. test: fix ci test

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    82988fd View commit details
    Browse the repository at this point in the history

  6. fix: added fixes for dremio cloud apis

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    7433b8b View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2024

  1. fix: added changes for profiling

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    dca1077 View commit details
    Browse the repository at this point in the history

  2. test: updated tests for profiling

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    42e6ec2 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2024

  1. fix: cloud region

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    e27d542 View commit details
    Browse the repository at this point in the history

Commits on Nov 5, 2024

  1. fix: minor changes

    @sagar-salvi-apptware
    sagar-salvi-apptware committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    2f8d07c View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into feat/dremio-connector-source

    @mayurinehate
    mayurinehate authored Nov 5, 2024
    Configuration menu
    Copy the full SHA
    ad405a9 View commit details
    Browse the repository at this point in the history