Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add support for loading manifest from cloud store using Airflow Object Store #1109

Merged
merged 11 commits into from
Jul 24, 2024
Merged

Add support for loading manifest from cloud store using Airflow Object Store #1109

merged 11 commits into from
Jul 24, 2024

Commits on Jul 24, 2024

  1. Add support for loading manifest from cloud store using Airflow Objec… 

    …t Store
    @pankajkoti
    pankajkoti committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    7b14cc5 View commit details
    Browse the repository at this point in the history

  2. Add tests and integration test example DAG for remote manifest files

    @pankajkoti
    pankajkoti committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    53425ac View commit details
    Browse the repository at this point in the history

  3. Install amazon[s3fs]

    @pankajkoti
    pankajkoti committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    a144923 View commit details
    Browse the repository at this point in the history

  4. Set min version to 2.8 for integration tests run for the cosmos_manif… 

    …est_example.py DAG
    @pankajkoti
    pankajkoti committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    245c3f8 View commit details
    Browse the repository at this point in the history

  5. Add branch for CI to allow passing secrets for testing the PR

    @pankajkoti
    pankajkoti committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    8cdfd22 View commit details
    Browse the repository at this point in the history

  6. Comment s3 manifest load task for testing

    @pankajkoti
    pankajkoti committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    2c64e5a View commit details
    Browse the repository at this point in the history

  7. Revert "Comment s3 manifest load task for testing" 

    This reverts commit 4ee726a.
    @pankajkoti
    pankajkoti committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    bb6fc8f View commit details
    Browse the repository at this point in the history

  8. Address review comments from @tatiana and add docs

    @pankajkoti
    pankajkoti committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    4fc32dc View commit details
    Browse the repository at this point in the history

  9. Fix docs

    @pankajkoti
    pankajkoti committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    4c01e15 View commit details
    Browse the repository at this point in the history

  10. Remove upper bound for the amazon provider as the issue is resolved

    @pankajkoti
    pankajkoti committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    e7370d1 View commit details
    Browse the repository at this point in the history

  11. Apply suggestions from code review 

    Co-authored-by: Tatiana Al-Chueyr <[email protected]>
    @pankajkoti @tatiana
    pankajkoti and tatiana committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    ecee4db View commit details
    Browse the repository at this point in the history